Position: Azure Snowflake
Azure :-Hands on experience in ADF – Azure Data Factory
Nos of Resources required: 1 to 2
Work location: As of now Remote (Bangalore)
Experience: 5 yrs – 6 yrs
Mobilization Period in weeks: 2 weeks
Duration: 6 to 12 months
Position: PySpark Developer
Must Have Technical Skills: PySpark
Good to have Technical Skills: Spark, DWH
· Hand on experience in Pyspark and Numpy, List, Pandas, Graph plotter.
· Excellent knowledge of Python framework and Airflow/Luigi/Dagster/Apache Beam.
· Python skills with all sorts of data libraries, visualization libraries,
· Good SQL knowledge.
· Ability to perform multiple task in continually changing environment.
· Exposure on Hive/HBase/Redis.
· Good knowledge of Data warehousing.
· Reading from Parquet and other format.
· Worked on Hive and HBase.
Nos of Resources required: 3 to 4
Work location: Remote
Qualification: BTech
Experience: 4 yrs – 5 yrs
Mobilization Period in weeks: 1 week
Duration: 3 to 6 months
We are looking at augmenting our team with an ML Engineer. We are a retail house and need an ML Engineer to train for our upcoming e commerce venture.
Position: NiFi /Big Data Developer
Must Have Technical Skills: NiFi
Good to have Technical Skills: Python, ETL
Preferred Industry Experience: Telecom
· Extensive experience on Nifi to setup data pipeline.
· Hands on experience in using controllers and processors to setup ETL framework in Apache Nifi
· Extensive experience in Python
· Food understanding on Spark, Spark Streaming & PySpark.
· Good understanding of Big Data components
Nos of Resources required: 2 to 3
Work location: Remote
Qualification: BTech
Experience: 4 yrs – 5 yrs
Mobilization Period in weeks: 1 week
Duration: 3 to 6 months
Web Scrapping Programmers:
· As a Python Developer, your role is to apply your knowledge set to fetch data from multiple online sources, cleanse it and build APIs on top of it
· Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store this data
· Work closely with Database Administrators to store data in SQL and NoSQL databases
· Develop frameworks for automating and maintaining the constant flow of data from multiple sources
· Work independently with little supervision to research and test innovative solutions
Skills and Qualifications:
· Strong coding experience in Python (knowledge of Java, Javascript is a plus)
· Experience with SQL databases
· Experience with multi-processing, multi-threading and AWS/Azure
· Strong knowledge of scraping frameworks such as Python(Request, BeautifulSoup), Web-Harvest and others
· Previous experience with web crawling is a must
Experience:
Job location:
Duration:
Joining: