Format | Extensions | Max Size | Notes |
---|---|---|---|
Plain Text | .txt, .md, .csv | 100MB | UTF-8 encoding recommended |
Rich Text | .rtf, .docx, .odt | 100MB | Formatting is preserved during processing |
Markup | .html, .xml, .json | 50MB | Structure is parsed and indexed |
Code | .py, .js, .java, etc. | 25MB | Language-specific tokenization is applied |
500 requests per day
100 requests per hour
5 concurrent requests
50,000 requests per day
5,000 requests per hour
100 concurrent requests
Custom limits
Priority processing
Dedicated resources
Rate Limit Headers
X-RateLimit-Reset
value is a Unix timestamp indicating when the rate limit window resets.Rate Limit By Endpoint
Endpoint | Max Requests (Free) | Max Requests (Developer) | Max Requests (Business) |
---|---|---|---|
/search | 100/hour | 500/hour | 2,500/hour |
/upload | 50/hour | 250/hour | 1,000/hour |
/processing | 20/hour | 100/hour | 500/hour |
Rate Limit Exceeded
429 Too Many Requests
response with a Retry-After
header indicating the number of seconds to wait before retrying.Free Tier: 5GB storage
Developer Tier: 100GB storage
Business Tier: 1TB storage
Enterprise Tier: Custom storage limits
Maximum batch size: 100 objects
Maximum pipeline complexity: 10 extractors
Maximum processing time: 30 minutes per object
Search Query Limits
Parameter | Free Tier | Developer Tier | Business Tier | Enterprise Tier |
---|---|---|---|---|
Max query length | 256 chars | 1,024 chars | 4,096 chars | 8,192 chars |
Max results per query | 100 | 500 | 1,000 | 5,000 |
Max filter complexity | 3 conditions | 10 conditions | 25 conditions | 50 conditions |
Batch Processing Limits
Operation | Free Tier | Developer Tier | Business Tier | Enterprise Tier |
---|---|---|---|---|
Max batch upload size | 10 objects | 50 objects | 100 objects | 500 objects |
Max batch processing | 5 objects | 25 objects | 100 objects | Custom |
Max parallel pipelines | 2 | 5 | 10 | Custom |