Few More Questions in Hadoop Interview

      1)        Explain about the current roles and responsibilities ?
2)        Difference between Hadoop1 and hadoop2?
3)        How much size of the cluster your using currently?
4)        Difference between writable and writeomparable in map reduces programming?
5)        Did you combiners in map reduce how to use?
6)        Did you use counters in map reduce programming?
7)        How to write code portions in map reduce programming?
8)        How to do serialize and deserialization the data in map reduce progrmming?
9)        How to swap two data columns date by 11/11, 11/12 in hive.
10)     Did you use d-link how to connect with the hive?
11)     How to do bucking in map reduce?
12)     How to merge two tables eg small and big table using pig or hive?
13)     What is purpose of the spark and what is RDD and context?
14)     Did you write UDF’s in Hive what purpose did you write?
15)     Difference between orderby and sort by in hive?
16)     What is the hive metastore and purpose of this?
17)     How to clean the data with special characters in PIG?
18)     What is kafka and how manage this into traditional way?
19)     What are the main components in STORM?
20)     Solr usage and why you used this into your project?

Thanks

Narasimha

Hadoop QA/QE Roles and Migrate notes Basics

Hadoop has 2 noteworthy Distributions

Cloudera and Hortonworks 

significant center parts : 

HDFS(Data capacity) and MAP reduce(processing u can use phython/scala/java) and major roles which company's are looking underneath below

1. Hadoop Admin 

2. Hadoop Development 

3. Hadoop QA/QE 

Hadoop Admin - is equivalent to framework/web/system administrator 

Hadoop development - for any java,Scala, Phython software developers

Hadoop QA - for the analyzer who has min experience at least basics on java/scala 

i. How relavent it is for QA ? 

Answer: 

in the event that you learn hadoop you have the splendid future. let say you can discover the occupation like the prerequisites 

* Plan, code, and execute computerized testing (with some manual testing if mechanization is impractical). This is the fundamental center of the position. 

* Analyze issues, report absconds, and propose relapse tests to find re events. 

* Work intimately with numerous improvement groups on end-to-end testing. 

* Check for information consistency over numerous sources. 

* Manufacture reenacted full generation situations for complex testing situations. 

* Manufacture and convey custom testing structures for REST-based API's utilizing JSON information positions. 

back ground of this : you ought to know junit testing, manual , Automation and REST web services testing which we have parcel of occupations going on you need to do end to end testing. 

you can discover the ETL utilizing a percentage of the apparatus like Talend..etc 

ii. On the off chance that I learn Haddop now, Where do I begin (which postition) my profession ? Would I be able to begin from where I was remaining in QA ? 

yes you will begin anyplace like same which you working at present in QA. Hadoop QA lead, Hadoop QA Engineering, HAdoop QA Automation..etc 

nothing change what your are currently working however this is extra and new innovation. 

I trust you get clear picture now. 

********* 

presently part of innovation came into picture like 

Spark - this is new Hadoop highlight executed by Scala(functional+object oriented Language) in memory calculation instead of disk. 

IOT + Big Data - attempt to concentrate on this is amazing element on the off chance that you can discover the you-tube you can get more thought what is IOT. 

It would be ideal if you survey and let me know whether you require any illumination require on this..