SqlRequestQueueClient | API | Crawlee for Python · Fast, reliable Python web crawlers.
Index
Methods
- __init__(*, id, storage_client): None
Parameters
keyword-onlyid: str
keyword-onlystorage_client: SqlStorageClient
Returns None
- async add_batch_of_requests(requests, *, forefront): AddRequestsResponse
Parameters
requests: Sequence[Request]
optionalkeyword-onlyforefront: bool = False
Returns AddRequestsResponse
- async drop(): None
Returns None
- async fetch_next_request(): Request | None
Returns Request | None
- async get_metadata(): RequestQueueMetadata
- async get_request(unique_key): Request | None
Parameters
unique_key: str
Returns Request | None
- async get_session(*, with_simple_commit): AsyncIterator[AsyncSession]
Parameters
optionalkeyword-onlywith_simple_commit: bool = False
Returns AsyncIterator[AsyncSession]
- async is_empty(): bool
Returns bool
- async mark_request_as_handled(request): ProcessedRequest | None
Parameters
request: Request
Returns ProcessedRequest | None
- async open(*, id, name, alias, storage_client): Self
Parameters
keyword-onlyid: str | None
keyword-onlyname: str | None
keyword-onlyalias: str | None
keyword-onlystorage_client: SqlStorageClient
Returns Self
- async purge(): None
Returns None
- async reclaim_request(request, *, forefront): ProcessedRequest | None
Parameters
request: Request
optionalkeyword-onlyforefront: bool = False
Returns ProcessedRequest | None