Position: PySpark Developer

Must Have Technical Skills: PySpark

Good to have Technical Skills: Spark, DWH

·         Hand on experience in Pyspark and Numpy, List, Pandas, Graph plotter.

·         Excellent knowledge of Python framework and Airflow/Luigi/Dagster/Apache Beam.

·         Python skills with all sorts of data libraries, visualization libraries,

·         Good SQL knowledge.

·         Ability to perform multiple task in continually changing environment.

·         Exposure on Hive/HBase/Redis.

·         Good knowledge of Data warehousing.

·         Reading from Parquet and other format.

·         Worked on Hive and HBase.

Nos of Resources required: 3 to 4

Work location: Remote

Qualification: BTech

Experience: 4 yrs – 5 yrs

Mobilization Period in weeks: 1 week

Duration: 3 to 6 months  

AWS Developer

• Should have strong knowledge of AWS Cloud libraries
• Proficiency in developing, deploying, and debugging cloud-based applications using AWS Services - EC2, ECS, EKS, Lambda, DynamoDB, SQS, Cognito, CloudFormation
• Knowledge on Java, Spring boot, Spring Integration, Node JS
• Ability to use the AWS service APIs, AWS CLI, and SDKs to write applications
• Ability to use a CI/CD pipeline to deploy applications on AWS
• Ability to write code using AWS security best practices (e.g., not using secret and access keys in the code, instead using IAM roles)
• Hands-on experience working in an agile/iterative development environment
• Develop and deploy AWS cloud-based solutions, services, and interfaces
• Participate in all phases of software engineering including; requirements, design, coding and testing.
• Design and implement product features in collaboration with product managers and stakeholder.
• Design reusable components, frameworks and libraries or micro-services
• Participate in an Agile/Scrum methodology to deliver high-quality software releases every 2 weeks

Nos of Resources required: 5 to 6

Work location: Remote (Bangalore/Mumbai)

Qualification: BTech

Experience: 4 yrs – 8 yrs

Mobilization Period in weeks: 2 week

Duration: 6 to 12 months  

Position: Azure Snowflake

• Demonstrated ability to have successfully completed multiple, complex technical projects and create high-level design and architecture of the solution, including class, sequence and deployment infrastructure diagrams.
• Take ownership of technical solutions from design and architecture perspective for projects in presales phase as well as on-going projects.
• Prior experience with application delivery using an Onshore/Offshore model
• Experience with gathering end user requirements and writing technical documentation
• Time management and multitasking skills to effectively meet deadlines under time-to-market pressure
• Suggest innovative solutions based on new technologies and latest trends to sales team.
• Review the architectural/ technological solutions for ongoing projects and ensure right choice of solution.
• Work closely with sales team and clients to understand their business, capture requirements, identify pain areas, accordingly, propose an ideal solution and win business.

Azure :-Hands on experience in ADF – Azure Data Factory

• Hands on experience in Big Data & Hadoop ECO Systems
• Exposure to Azure Service categories like PaaS components and IaaS subscriptions
• Ability to Design, Develop ingestion & processing frame work for ETL applications
• Hands on experience in powershell scripting, deployment on Azure
• Experience in performance tuning and memory configuration
• Should be adaptable to learn & work on new technologies
• Should have Good written and spoken communication skill

Nos of Resources required: 1 to 2

Work location: As of now Remote (Bangalore)

Experience: 5 yrs – 6 yrs

Mobilization Period in weeks: 2 weeks

Duration: 6 to 12 months 

We need a proficient PySpark resource with good experience.

Web Scrapping Programmers:

·        As a Python Developer, your role is to apply your knowledge set to fetch data from multiple online sources, cleanse it and build APIs on top of it

·        Develop a deep understanding of our vast data sources on the web and know exactly how, when, and which data to scrap, parse and store this data

·        Work closely with Database Administrators to store data in SQL and NoSQL databases

·        Develop frameworks for automating and maintaining the constant flow of data from multiple sources

·        Work independently with little supervision to research and test innovative solutions

Skills and Qualifications:

·        Strong coding experience in Python (knowledge of Java, Javascript is a plus)

·        Experience with SQL databases

·        Experience with multi-processing, multi-threading and AWS/Azure

·        Strong knowledge of scraping frameworks such as Python(Request, BeautifulSoup), Web-Harvest and others

·        Previous experience with web crawling is a must

Experience:

• 1 to 2 years

Job location:

• Bangalore/Chennai/ Hyderabad

Duration:

• 3 months. May get extended.

Joining:

• immediate