Databay¶
Databay is a Python interface for scheduled data transfer.
It facilitates transfer of (any) data from A to B, on a scheduled interval.
GitHub Page¶
pip install databay
Overview - Learn what is Databay.
Examples - See Databay in use.
Extending Databay - Use Databay in your project.
API Reference - Read the API documentation.
Features¶
Simple, decoupled interface |
Easily implement data production and consumption that fits your needs. |
Granular control over data transfer |
Multiple ways of passing information between producers and consumers. |
Asyncio supported |
|
We’ll handle the rest |
Scheduling, startup and shutdown, exception handling, logging. |
Support for custom scheduling |
Use your own scheduling logic if you like. |
# Data producer
inlet = HttpInlet('https://some.test.url.com/')
# Data consumer
outlet = MongoOutlet('databay', 'test_collection')
# Data transfer between the two
link = Link(inlet, outlet, datetime.timedelta(seconds=5))
# Start scheduling
planner = ApsPlanner(link)
planner.start()
Every 5 seconds this snippet will pull data from a test URL, and write it to MongoDB.
Explore this documentation: