swh.storage.proxies.blocking package#

Submodules#

Module contents#

swh.storage.proxies.blocking.get_datastore(cls, db=None, blocking_db=None, **kwargs)[source]#
swh.storage.proxies.blocking.blocking_overhead_timer(method_name: str) → DifferentialTimer[source]#

Return a properly setup DifferentialTimer for method_name of the storage

class swh.storage.proxies.blocking.BlockingProxyStorage(storage: Dict | StorageInterface, db: str | None = None, blocking_db: str | None = None, min_pool_conns: int = 1, max_pool_conns: int = 5)[source]#

Bases: object

Blocking storage proxy

This proxy prevents visits from a known list of origins to be performed at all.

It uses a specific PostgreSQL database (which for now is colocated with the swh.storage PostgreSQL database), the access to which is implemented in the db submodule.

Sample configuration

origin_visit_status_add(visit_statuses: List[OriginVisitStatus]) → Dict[str, int][source]#
origin_visit_add(visits: List[OriginVisit]) → Iterable[OriginVisit][source]#
origin_add(origins: List[Origin]) → Dict[str, int][source]#