A new press release states, “Trifacta, the global leader in data preparation, today announced a new set of capabilities designed to enable data engineers within data operations (DataOps) practices to more efficiently develop, test, schedule and monitor data preparation pipelines in production. With RapidTarget, Trifacta customers can utilize an existing data model to intelligently guide […]
Dremio Bridges the Gap Between Data Engineers and Data Consumers
According to a new press release, “Dremio, the Data-as-a-Service Platform company, announced today a major release of its open source platform that includes a collaborative data catalog; along with new controls for multi-tenant deployments, end-to-end data encryption, and a breakthrough in performance and efficiency through the Gandiva Initiative for Apache Arrow. These new features support […]
Five Ways Data Engineers Are Leveraging Self-Service Data Prep Solutions
Click to learn more about author Farnaz Erfan. With the growth of Big Data Analytics, data engineers are now gaining a lot of popularity. And, while the majority of them have coding and technical skills, ETL knowledge, or can program in MapReduce, many have found that applying a Self-service Data Prep solution can help them […]
Infoworks’ Autonomous Data Engine V2.4 Delivers Agile Data Engineering On-premises and in the Cloud
A new press release states, “Infoworks, the leading provider of agile data engineering software platforms, today announced the release of Infoworks’ Autonomous Data Engine (ADE) 2.4, the latest release of the company’s end-to-end automated software platform for agile data engineering. Infoworks ADE automates the entire data engineering process, from the data source to the point […]
Databricks Launches New Edition of Its Apache Spark-Based Cloud Platform for Data Engineers
by Angela Guess According to a new press release, “Databricks, the company founded by the creators of the popular Apache Spark project and providers of the leading Spark-based cloud platform for data science, today announced an edition of its cloud platform optimized specifically for data engineering workloads called Databricks for Data Engineering. The new offering […]
The Tech Industry Is in the Middle of a Data Engineering Talent Shortage
by Angela Guess According to a new press release, “A new study, The State of Data Engineering released today by Stitch, an ETL service; and Galvanize, a learning community for technology, reveals a shortage in data engineering talent. There are only 6,500 self-reported data engineers on LinkedIn, but the San Francisco Bay area alone has […]