Apache Airflow is a great data pipeline as code, but having most of its contributors work for Astronomer is another example of a problem with open source. Depending on your politics, trickle-down ...

Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Birgitta Böckeler, Distinguished Engineer at ...

MotherDuck Corp., the maker of a cloud-native data warehouse based on the open-source DuckDB analytical engine, is betting ...

The rise of vibe coding can further amplify these problems as more operational context, architectural decisions, and business knowledge become scattered across prompts, conversations, generated code, ...

Using workarounds to pipe data between systems carries a high price and untrustworthy data. Bharath Chari shares three possible solutions backed up by real use cases to get data streaming pipelines ...

The second major version of Azure Data Factory, Microsoft's cloud service for ETL (Extract, Transform and Load), data prep and data movement, was released to general availability (GA) about two months ...