Catching a Trojan: Finding a malicious Conduit connector in the wild
A third-party created a Conduit connector with malicious code, here's how we found it, and got it removed.
By Lovro Mažgon
29 Apr 2025
#Open source Posts
Benchmarking Made Simple with Benchi
Benchi is a minimal benchmarking framework designed to help you measure the performance of your applications and infrastructure. It leverages Docker to create isolated environments for running benchmarks and collecting metrics.
By Lovro Mažgon
26 Mar 2025
New Release Conduit 0.13: Advanced Automation, New CLI, and 5x Performance Gains
The latest Conduit 0.13 release brings significant upgrades, focusing on developer experience, automation, and performance optimization. Key highlights include automated documentation synchronization for connectors, a powerful new CLI for seamless pipeline and connector management, and 5x improvements in output processing speed, reducing latency and boosting efficiency. Notably, this version also deprecates the built-in UI, reinforcing Conduit’s commitment to a CLI-driven workflow. With expanded CLI capabilities and automated documentation tools, developers can now manage data pipelines more efficiently than ever. Upgrade today to leverage these new features and maximize your real-time data processing capabilities! 🚀
By Dion Keeton
7 Feb 2025
Automating documentation for 100+ connectors
The Conduit 0.13 release introduces `connector.yaml`, a powerful automation tool that ensures connector documentation stays up to date with the latest configuration changes. By centralizing connector metadata—such as parameters, descriptions, and validation rules—developers can seamlessly sync documentation across repositories and the official Conduit docs. With the `conn-sdk-cli` tool, updating documentation is as simple as running a command, eliminating manual updates and reducing errors. This release enhances the developer experience, improves documentation consistency, and streamlines real-time data pipeline management. Start using `connector.yaml` today and automate your documentation workflow! 🚀
5 Feb 2025
Introducing the New Conduit CLI: A Powerful Tool for Managing Your Pipelines
The Conduit 0.13 release introduces a powerful new CLI that simplifies real-time data pipeline management. With intuitive commands, developers can configure, monitor, and run pipelines directly from the terminal—eliminating complex API calls and manual configurations. Optimized for speed and efficiency, the CLI enhances deployment, troubleshooting, and high-throughput data streaming. Upgrade to Conduit 0.13 and streamline your data workflows today! Try it now with `$ conduit --help`. 🚀
By Maha Mustafa
5 Feb 2025
Unlock New Possibilities with Meroxa's Conduit OSS: New Connectors for Developers
At Meroxa, we’re empowering developers with Conduit OSS, a tool that simplifies real-time data engineering. With our latest release of new connectors, integrating with popular platforms is seamless, accelerating development and delivering real-time data insights. Here's a look at what's available now and what's coming next!
By Dion Keeton
31 Jan 2025
Optimizing Conduit - 5x the Throughput
In this blog, we dive into how Conduit transitioned from a flexible but slower architecture to a high-performance streaming engine. We explore the limitations of the old DAG-based design, its impact on ordering guarantees and backpressure, and why switching to a Worker-Task Model drastically improved throughput and efficiency. With real-world performance benchmarks showing a 5x increase in message throughput, this blog is a must-read for developers and data engineers looking to optimize their data pipelines. Learn how Conduit is setting a new standard for real-time data movement and how you can leverage these improvements today! 🚀
By Lovro Mažgon
29 Jan 2025
Meroxa’s 2024 Year in Review: Big Wins and a Bright Future in AI
Discover how Meroxa revolutionized real-time data integration in 2024 with powerful new connectors, including Amazon DynamoDB, Snowflake, Apache Kafka, and more, enabling seamless data movement across diverse systems. This blog highlights key updates to the Conduit Platform, such as pipeline recovery features in Conduit v0.12.0 and schema registry support in Conduit Operator v0.0.2, designed to enhance resilience and simplify Kubernetes deployments. We also dive into a compelling case study featuring a global hotel network that leveraged Meroxa’s platform to integrate customer data, boosting guest satisfaction by 30% and increasing revenue per available room by 20%. Whether you're building robust data pipelines, enabling real-time analytics, or driving AI-powered transformations, explore how Meroxa’s latest advancements are unlocking new possibilities for developers and data teams.
By Dion Keeton
31 Dec 2024
Champagne Week: Driving Innovation and Collaboration at Meroxa
Champagne Week embodies the creativity, dedication, and collaboration of the Meroxa team, showcasing innovative projects like enhanced documentation, real-time IoT processing, AI-powered summarization, and a collaborative demo that highlights our growth. Thank you to everyone who contributed to making this week a success—and to our users, who inspire us to keep raising the bar.
By Dion Keeton
16 Dec 2024
Conduit Operator v0.02 with Schema Registry Support!
We’re excited to introduce the latest update to the **Conduit Operator**, now with built-in **schema registry support**. This new feature allows seamless data encoding and decoding, improving data compatibility across your pipelines. Whether you're managing multiple Conduit instances or scaling your data operations, schema registry integration ensures a smoother, more reliable experience for handling complex data flows.
25 Oct 2024
Unlocking Resilience: Conduit v0.12.0 Introduces Pipeline Recovery
The Conduit team has just released Conduit v0.12, and we're gearing up for the launch of Conduit v1 with a focus on making pipelines more resilient. One key feature of this release is pipeline recovery, designed to automatically restart pipelines that experience temporary errors like network interruptions or service downtime. With configurable backoff settings, Conduit can efficiently handle retries, reducing the impact of transient issues. Learn more about this feature and how it ensures your pipelines are always up and running.
11 Oct 2024
Announcing the New Conduit Platform by Meroxa
We are thrilled to introduce our latest offering, the Conduit Platform, which brings a host of new features and improvements designed to enhance your real-time data streaming experience, now powered by our robust Conduit open-source core. This transformation brings enhanced performance, scalability, and usability, coupled with access to over 100 connectors maintained by our dedicated open-source community. Here’s a closer look at what’s new and how it can benefit your data operations.
By Dion Keeton
18 Jun 2024
Introduction to Meroxa's New Conduit Connector for Apache Flink
Conduit connector for Apache Flink, a powerful combination that significantly expands Flink’s capabilities. Apache Flink is renowned for its robust stream processing capabilities, while Conduit offers a lightweight and fast data streaming solution, simplifying the creation of connectors.
17 Jun 2024
Conduit 0.10 comes with Multiple collections support
Explore the new features and enhancements in Conduit version 0.10, designed to streamline your data integration processes. Discover how our latest update can help improve efficiency, security, and performance for your data operations. Upgrade today and transform how you manage data with Conduit 0.10
29 Apr 2024
Testing the Limits: Performance Benchmarks for Conduit
We decided to build a performance benchmark for Conduit early, so we could determine how much it can handle and what it takes to break it.
3 Nov 2022
