Best Tools for Data Engineers
5 tools ranked by rating and features
#1
Open-source observability and data visualization platform for creating dashboards from multiple data sources including Prometheus, InfluxDB, Elasticsearch, and more.
dashboardsdata-sourcesalertingannotations
✓ Connects to virtually any data source✓ Beautiful and highly customizable dashboards✓ Open-source with massive community
#2
Open-source orchestration platform for building scheduled workflows, data pipelines, and event-driven automations with declarative YAML and 500+ plugins.
workflow-orchestrationschedulingevent-triggersplugins
✓ Open-source with full orchestration capabilities✓ Declarative YAML workflows (GitOps friendly)✓ 500+ plugins for data, cloud, and messaging services
#3
Open-source data orchestration framework connecting LLMs with external data sources for building RAG pipelines, document Q&A, and AI agents.
ragdocument-parsingdata-connectorsai-agents
✓ Best-in-class RAG components✓ Largest connector ecosystem (200+ via LlamaHub)✓ Production-ready prepackaged agents
#4
Framework for developing applications powered by language models with chains and agents.
chainsagentsretrievalmemory
✓ Comprehensive framework✓ Large community✓ Many integrations
#5
Open-source BI tool that generates beautiful data reports from SQL and Markdown, deployed as static sites for fast, version-controlled analytics.
sql-reportingmarkdown-pageschartsstatic-deployment
✓ Code-based reports (version controlled)✓ Beautiful output✓ Fast static deployment