Jacques Nadeau, co-founder and CTO of Dremio and PMC Chair of Apache Arrow, commented, “Apache Arrow was created to provide an industry-standard, columnar, in-memory data representation… Dozens of open source and commercial technologies have since embraced Arrow as their standard for high-performance analytics. The Gandiva Initiative introduces a cross-platform data processing engine for Arrow, representing a quantum leap forward for processing data. Users will experience speed and efficiency gains of up to 100x in the coming months.”
The release adds, “LLVM is an open source project originally developed by Swift language creator Chris Lattner. LLVM’s Just-in-Time compilation capabilities incorporate runtime information to produce highly optimized assembly code for the fastest possible evaluation. By combining LLVM with Apache Arrow libraries, low-level operations on Apache Arrow in-memory buffers such as sorts, filters, and projections can be highly optimized for specific runtime environments, improving resource utilization and providing faster, lower-cost operations of analytical workloads.”
Read more at Business Wire.
Photo credit: Dremio