Softvision is a fast growing global digital development company. We help global companies in the areas of enterprise application development and integration, automation and machine learning, agile transformation, big data and analytics, full stack web, mobile, IoT, design and UX, QA and testing, infrastructure, and digital commerce.
We are looking for an exceptional Senior Data Engineer For this position you should be able to check the following : At least 5 years of experience in data engineering building data warehouses and data pipelines.
Built large scale, data driven applications including elements like real-time streaming, batch data aggregation, data modeling, data cleaning, anomaly detection and bulk ingestion.
Experience designing and writing robust ETL jobs. Experience with distributed data processing systems (Hive, Spark, Hadoop, etc.
A passion for problem solving and providing solutions. Strong software development skills at least one of the following : (Python, Java, Scala).
Extensive experience with SQL. Experience with AWS (EC2, S3, EFS, RDS, DynamoDB, Lambda, Redshift, Kinesis) Strong technical leadership skills.
A day in the life of a Senior Data Engi Designing, building, and deploying efficient data pipelines. Intelligently designing and implementing our data architecture.
Implementing inclusive data quality checks. Providing data-driven insights. Ensuring scalability. Meeting data privacy and data security standards.
Securely source external data from multiple partners