Unlock the full InfoQ experience by logging in! Stay updated with your favorite authors and topics, engage with content, and download exclusive resources. Jinsong Yu shares deep architectural insights ...

The immensely popular open-source cluster computing framework Apache Spark has just reached version 2.0, according to an announcement by the Apache Software Foundation (ASF) yesterday. Spark’s ...

Databricks Lakehouse Platform combines cost-effective data storage with machine learning and data analytics, and it's available on AWS, Azure, and GCP. Could it be an affordable alternative for your ...

Apache Spark is a project designed to accelerate Hadoop and other big data applications through the use of an in-memory, clustered data engine. The Apache Foundation describes the Spark project this ...

You probably did not hear it here first. Spark has been making waves in big data for a while now, and 2017 has not disappointed anyone who has bet on its meteoric rise. That was a pretty safe bet ...

Scott Guthrie, Microsoft EVP of Cloud & Enterprise. Microsoft Azure customers interested in parsing large amounts of data to improve their businesses will soon be able to use Azure Databricks, ...

Companies that want to run traditional enterprise BI workloads but don’t want to involve a traditional data warehouse may be interested in the new Databricks SQL service that became generally ...

AI and data analytics company Databricks today announced the launch of SQL Analytics, a new service that makes it easier for data analysts to run their standard SQL queries directly on data lakes. And ...

Databricks certifying SAP to run Spark? Wow - that's one for the books which opens up interesting questions around SAP HANA, where it goes, how it fits and the future of development in a mixed open ...