Position: AWS Data Engineer
Skill set: Big Data technologies, Python, PySpark
Experience: 4+ years
Notice Period: Immediate – Immediate
Location: Hyderabad (On-site)
Job Type: Full-Time
Positions: 5
About Us:
Soulpage IT Solutions is an AI/ML technology company based in Hyderabad, specializing in cutting-edge solutions for data engineering, AI, and cloud-based analytics. We are looking for an experienced Data Engineer with expertise in Big Data technologies, Python, and PySpark to join our team.
Key Responsibilities:
Develop and optimize PySpark applications using Spark DataFrames in Python. Work on large-scale data processing, ensuring performance optimization for high-volume data pipelines.
Implement best practices for version control using Git.
Work with Amazon Analytics services such as Amazon EMR, Amazon Athena, and AWS Glue.
Utilize Amazon Compute services including AWS Lambda, EC2, and storage solutions like S3, SNS.
Work with columnar storage formats like Parquet, Avro, ORC, and apply compression techniques (Snappy, Gzip).
Good to have experience with data warehousing concepts (dimensions, facts, schemas – Star, Snowflake).
Good to have experience with AWS databases such as Aurora, RDS, Redshift, ElastiCache, or DynamoDB.
Requirements:
4+ years of experience in IT, with strong hands-on expertise in Big Data technologies.
Mandatory: Hands-on experience in Python and PySpark.
Experience working on AWS ecosystem, including EMR, Athena, Glue, Lambda, EC2, S3, and SNS.
Strong understanding of data modeling and warehousing concepts.
Proficiency in working with structured and semi-structured data
Ability to optimize Spark jobs for better performance and efficiency.
Why Join Us?
Work on cutting-edge AI & ML projects in a fast-growing technology company.
Be part of an innovative and collaborative work environment.
Career growth opportunities in Big Data, AI, and Cloud technologies.
Competitive salary and benefits.
Application Process:
Interested candidates can send their resumes to [email protected] with the subject line:
Application for AWS Data Engineer
We look forward to welcoming passionate individuals to our team!