SQL

From Spark-2.0, Spark has its own built-in full fledged sql parser, which is a big step for its independence of Hive.

Please refer to following JIRAs.

Implement DDL/DML commands for Spark 2.0 Create native DDL commands

Replace ANTLR3 SQL parser by a ANTLR4 SQL parser

Create a full-fledged built-in SQL parser