Distributed Stream Library

The implementation includes:

• DistroStream: Stream interface to handle stream accesses homogeneously regardless of the stream engine backing it (Python and Java).
  • ObjectDistroStream: Implementation of the interface for object streams built on top of Kafka (Java).
  • FileDistroStream: Implementation of the interface for file streams that monitors the creation of files inside a directory (Python and Java).
• Client: Acts as a broker on behalf of the application and interacts with the corresponding stream backend (Python and Java).
• Server: Centralized server to manage the streams metadata and coordinate the accesses (Java).
• Test: Basic integration tests.

---

Table of Contents

• Contributing
• Author
• Disclaimer
• License

---

Contributing

All kinds of contributions are welcome. Please do not hesitate to open a new issue, submit a pull request or contact the author if necessary.

Author

Cristián Ramón-Cortés Vilarrodona <cristian.ramoncortes(at)bsc.es> (Personal Website)

This work is supervised by:

• Rosa M. Badia (BSC)
• Jorge Ejarque (BSC)
• Francesc Lordan (BSC)

Disclaimer

This work is part of a PhD Thesis at the Workflows and Distributed Computing Team at BSC and is still under development.

License

Licensed under the Apache 2.0 License