Big Data Developer

at Apex Systems Inc

location Phoenix, Arizona

Updated on May 16, 2018

Right to hire Position
6 month(s)

  • Referral Bonus

    $500

    approx.
  • Signing Bonus

    $500

    approx.

Pay Rate $44.10 per hour

Experience 3-7 Years

Eligibility H-1B visa, US citizen

Industry

Information Technology Services

Travel

Not Specified

Job ID

PATDC567690

Working Remotely Allowed

No

JOB DESCRIPTION

Candidate must be local.
Face to face interview required.

Primary Skills: Big Data/Hadoop, Spark, Python to automate

Description:
Tech Stack: Big data technologies, Hadoop Map reduce jobs, Python, Spark, Spark SQL, Columnar databases, Performance tuning
Relevant experience: At least 4-5 years

Proven hands-on Software Development & implementation experience with big data technologies using Hadoop & Map Reduce technologies.
Proven working experience in Designing, Building & Implementing solutions using Spark 2.3.
Experience of Pyspark & Spark SQL is a must.
Experience with Python to automate manual tasks and process high complexity datasets is a must.
Proven experience working with Columnar databases, Parquet, ORC formats, Datasets & DataFrames concepts.
Experience with performance tuning and concepts such as Bucketing, Sorting and Partitioning
Ability to integrate UDFs with Spark jobs
Experience working on machine learning models using python is a plus
Experience with slack integrations using python is a plus
Experience in debugging issues, resolving performance issues and coordination with external teams (as needed) until successful resolution of issues.
Experience in working with version control tools (GIT preferred).
Experience with test-driven development along with implementing coding best practices such as exception handling, logging etc.
Must have DevOps mindset actively working on automation, building continuous build, integration, testing & deployment pipelines using Jenkins, XLR, Lisa & Lara.
Good to have: Working experience with Atlasian suite of tools
Good to have: Certifications on Big Data technologies

Other skills:
1.     Experience working in agile methodology

Similar Jobs

BRILLIANT FEATURES

Earn money by referring your friends to their next dream job, or find a job for yourself and the Referral Bonus becomes a Signing Bonus. Full time or Contract.

  • Make Money

    We’ll give you between several hundred and several thousand dollars for every successful referral.

  • Help Your
    Friends

    Job applications with personal recommendations are twice as likely to get hired.

  • 100% Free

    Absolutely zero sign up and subscription fees. We want to pay YOU!

  • Signing Bonuses

    All jobs on iEndorseU come with a Signing Bonus if you find a job for yourself

  • No credit card needed

    We pay you directly through Paypal, so keep your personal information…personal.

  • Sponsor others

    Get others to download our app and we will pay you $100 whenever they next get a job through our platform.

All the ways to make money from us