Difference between Pig and Hive? Why have both?

[hari_prasad]

Hi,
My background - 4 weeks old in the Hadoop world. Dabbled a bit in Hive, Pig, and Hadoop using Cloudera's Hadoop VM. Have read Google's paper on Map-Reduce and GFS .

I understand that-

   Pig's language Pig Latin is a shift from(suits the way programmers think) SQL like a declarative style of programming and Hive's query language closely resembles SQL.
  Pig sits on top of Hadoop and in principle can also sit on top of Dryad. I might be wrong but Hive is closely coupled to hadoop.
 Both Pig Latin and Hive commands compile to Map and Reduce jobs.

My question - What is the goal of having both when one (say Pig) could serve the purpose. Is it just because Pig is evangelized by Yahoo! and Hive by Facebook?
Thanks
Hari

[ruchi_chouhan]

Hive is a data warehouse infrastructure tool to process. But pig is data flow Language .
Hive is a relational database but pig is not a relational database.
Hive is mostly for structured data but pig handle any type of data like structured ,semi structured and unstructure.

why have both.

programmers who are not good at java normally used to struggle working with hadoop. Pig is a boon for all such programmers.
Hive is reside on top of hadoop to summarize big data and makes querying and analyzing easy.

[Atul_Shrivastava]

To add what Ruchi said, now Spark/Scala has effectively replaced both Hive and PigLatin, unless n untill u r too comfortable with HQL and your database is in Hive only. Spark is widely been hailed as the end of MapReduce. Unlike Pig and Hive, which are merely programming interfaces for the execution framework, Spark replaces the execution framework of MapReduce entirely. Spark provides most effective memory and resource usage, almost 100 times faster then the MapR. Spark also provides many features, including stream processing, data transfer, fast fault recovery, optimized scheduling, and a lot more. Read more at https://nexcenblog.wordpress.com/2018/01/28/big-data-revolution/

[Aditya_Kumar]

hadoop

Hi Ruchi ,

If Hive is a relational database then what is the difference between Hive and MySql.
Can we use Mysql in place of Hive?

[ruchi_chouhan]

Hive is used for large datasets and complex queries.If you work in small dataset then Hive will response very fast and give result in shortly time .But if you have small dataset then MySql is the best but not for large data set.

Hive is not use for online analytical processing but MySql is use.
No you cant use MySql in place of Hive.