Job Description
**Required skills:**
+ **Experience of 05-08 years in Big Data Development required.**
+ Proficient understanding of distributed computing principles
+ Management of Hadoop cluster, with all included services
+ Programming experience, ideally in Spark, or Java, and a willingness to learn new programming languages to meet goals and objectives.
+ Proficiency with Hadoop v2, MapReduce, HDFS
+ Experience with building stream-processing systems, using solutions such as Python or Spark-Streaming
+ Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
+ Experience with integration of data from multiple data sources
+ Should have Spark Job implementation experience with Java/Scala- both Batch and Streaming jobs.
+ Strong troubleshooting knowledge of Java, Spark, SQLs
+ Experience with Cloudera/MapR/Hortonworks
**Responsibilities:**
+ Gather and process raw data at scale.
+ Design and develop data applications using selected tools and frameworks as required and requested.
+ Read, extract, transform, stage and load data to selected tools and frameworks as required and requested.
+ Perform tasks such as writing scripts, web scraping, calling APIs, write SQL queries, etc.
+ Work closely with the engineering team to integrate your work into our production systems.
+ Process unstructured data into a form suitable for analysis.
+ Analyze processed data.
+ Support business decisions with ad hoc analysis as needed.
+ Monitoring data performance and modifying infrastructure as needed.
+ Define data retention policies.
+ Sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
**Education:**
Bachelor's degree/University degree or equivalent experience
Master's degree
-------------------------------------------------
**Job Family Group:**
Technology
-------------------------------------------------
**Job Family:**
Applications Development
------------------------------------------------------
**Time Type:**
Full time
------------------------------------------------------
Citi is an equal opportunity and affirmative action employer.
Qualified applicants will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
Citigroup Inc. and its subsidiaries ("Citi) invite all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review **Accessibility at Citi (https://www.citigroup.com/citi/accessibility/application-accessibility.htm)** .
View the "EEO is the Law (https://www.dol.gov/sites/dolgov/files/ofccp/regs/compliance/posters/pdf/eeopost.pdf) " poster. View the EEO is the Law Supplement (https://www.dol.gov/sites/dolgov/files/ofccp/regs/compliance/posters/pdf/OFCCP\_EEO\_Supplement\_Final\_JRF\_QA\_508c.pdf) .
View the EEO Policy Statement (http://citi.com/citi/diversity/assets/pdf/eeo\_aa\_policy.pdf) .
View the Pay Transparency Posting (https://www.dol.gov/sites/dolgov/files/ofccp/pdf/pay-transp\_%20English\_formattedESQA508c.pdf)
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.