Position: PySpark Developer

Must Have Technical Skills: PySpark

Good to have Technical Skills: Spark, DWH

·         Hand on experience in Pyspark and Numpy, List, Pandas, Graph plotter.

·         Excellent knowledge of Python framework and Airflow/Luigi/Dagster/Apache Beam.

·         Python skills with all sorts of data libraries, visualization libraries,

·         Good SQL knowledge.

·         Ability to perform multiple task in continually changing environment.

·         Exposure on Hive/HBase/Redis.

·         Good knowledge of Data warehousing.

·         Reading from Parquet and other format.

·         Worked on Hive and HBase.

Nos of Resources required: 3 to 4

Work location: Remote

Qualification: BTech

Experience: 4 yrs – 5 yrs

Mobilization Period in weeks: 1 week

Duration: 3 to 6 months  

We need a proficient PySpark resource with good experience.

Position: Azure Pyspark

Pyspark + with Data warehousing and Azure will be add on.

·         Must have low level design and development skills.  Should able to design a solution for a given use cases. 

·         Agile delivery- Person must able to show design and code on daily basis

·         Must be an experienced PySpark developer and Scala coding.   Primary skill is PySpark

·         Must have experience in designing job orchestration, sequence, metadata design, Audit trail, dynamic parameter passing and error/exception handling

·         Good experience with unit, integration and UAT support

·         Able to design and code reusable components and functions

·         Should able to review design, code & provide review comments with justification

·         Zeal to learn new tool/technologies and adoption

·         Good to have experience with Devops and CICD

Nos of Resources required: 1 to 2

Work location: Bangalore

Experience: 8 yrs – 9 yrs

Mobilization Period in weeks: 2 weeks

Machine Learning Programmers:

Responsibilities

• Study and transform data science prototypes
• Design machine learning systems
• Research and implement appropriate ML algorithms and tools
• Develop machine learning applications according to requirements
• Select appropriate datasets and data representation methods
• Run machine learning tests and experiments
• Perform statistical analysis and fine-tuning using test results
• Train and retrain systems when necessary
• Extend existing ML libraries and frameworks
• Keep abreast of developments in the field

Requirements

• Proven experience as a Machine Learning Engineer or similar role
• Understanding of data structures, data modeling and software architecture
• Deep knowledge of math, probability, statistics and algorithms
• Ability to write robust code in Python, Java and R
• Familiarity with machine learning frameworks (like Keras or PyTorch) and libraries (like scikit-learn)
• Excellent communication skills
• Ability to work in a team
• Outstanding analytical and problem-solving skills
• BSc in Computer Science, Mathematics or similar field; Master’s degree is a plus

Experience:

• 2 to 3 years

Job location:

• Bangalore/Chennai/ Hyderabad (WFH at the moment)

Duration:

• 3 months. May get extended.

Joining:

• immediate

Position: NiFi /Big Data Developer 

Must Have Technical Skills: NiFi

Good to have Technical Skills: Python, ETL

Preferred Industry Experience: Telecom

·         Extensive experience on Nifi to setup data pipeline.

·         Hands on experience in using controllers and processors to setup ETL framework in Apache Nifi

·         Extensive experience in Python

·         Food understanding on Spark, Spark Streaming & PySpark.

·         Good understanding of Big Data components

Nos of Resources required: 2 to 3

Work location: Remote

Qualification: BTech

Experience: 4 yrs – 5 yrs

Mobilization Period in weeks: 1 week

Duration: 3 to 6 months  

Web Scrapping Programmers:

·        As a Python Developer, your role is to apply your knowledge set to fetch data from multiple online sources, cleanse it and build APIs on top of it

·        Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store this data

·        Work closely with Database Administrators to store data in SQL and NoSQL databases

·        Develop frameworks for automating and maintaining the constant flow of data from multiple sources

·        Work independently with little supervision to research and test innovative solutions

Skills and Qualifications:

·        Strong coding experience in Python (knowledge of Java, Javascript is a plus)

·        Experience with SQL databases

·        Experience with multi-processing, multi-threading and AWS/Azure

·        Strong knowledge of scraping frameworks such as Python(Request, BeautifulSoup), Web-Harvest and others

·        Previous experience with web crawling is a must

Experience:

• 1 to 2 years

Job location:

• Bangalore/Chennai/ Hyderabad

Duration:

• 3 months. May get extended.

Joining:

• immediate