- Work in collaboration with the application team and integration team to design, create, and maintain optimal data pipeline architecture and data structures for Data Lake/Data Warehouse.
- Work with stakeholders including the Sales, Product, and Customer Support teams to assist with data-related technical issues and support their data analytics needs.
- Assemble large, complex data sets from third-party vendors to meet business requirements.
- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
- Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Elasticsearch, MongoDB, and AWS technology.
- Streamline existing and introduce enhanced reporting and analysis solutions that leverage complex data sources derived from multiple internal systems.
Requirements
- 5+ years of experience in a Data Engineer role.
- Proficiency in Linux.
- Must have SQL knowledge and experience working with relational databases, query authoring (SQL) as well as familiarity with databases including Mysql, Mongo, Cassandra, and Athena.
- Must have experience with Python/Scala.
- Must have experience with Big Data technologies like Apache Spark.
- Must have experience with Apache Airflow.
- Experience with data pipeline and ETL tools like AWS Glue.
- Experience working with AWS cloud services: EC2, S3, RDS, Redshift.
Similar jobs
1. We are looking out for a go-getter who can review the existing sales pipeline and create new sales funnel!
2. Someone who can manage smooth relationships with clients & vendors
3. Creating strategy around growth and implementing the same
4. Research & identify new market opportunities
We have recently started our growth phase and now looking out for some really talented folks to join us and help us grow!
ExpertRight lives on the concept of people-first, I can assure you exciting & adrenaline-filled career ahead!
- Understand fundamental design principles and best practices for developing backend servers and web applications Gather requirements, scope functionality, estimate and translate those requirements into solutions.
- Implement and integrate software features as per requirements.
- Deliver across the entire app life cycle.
- Work in a product creation project and/or technology project with implementation or integration responsibilities, Improve an existing code base, if required, and ability to read source code to understand data flow and origin
- Design effective data storage for the task at hand and know how to optimize query performance along the way.
- Follow an agile methodology of development and delivery
- Strictly adhere to coding standards and internal practices; must be able to conduct review code Mentor and possibly lead junior developers
- Contribute towards innovation Performance optimization of apps
- Explain technologies and solutions to technical and non-technical stakeholders
- Diagnose bugs and other issues in products
- Continuously discover, evaluate, and implement new technologies to maximize development efficiency
Must have / Good to have:
- 4+ years experience with Core Python development Design and implementation of high-availability, and performant applications on Unix environment
- Good with multithreading and data structures
- Develop back-end components to improve responsiveness and overall performance
- Familiarity with database design, integration wiht applications and python packaging. Familiarity with front-end technologies (like JavaScript and HTML5), REST API, security considerations
- Familiarity with functional testing and deployment automation frameworks
- Experience in development for 3-4 production ready application using Python as programming language
- Experience in writing unit test cases including positive and negative test cases
- Experience of CI/CD pipeline code deployment (Git, SVN, Jenkins or Teamcity)
- Experience with Agile and DevOps methodology
- Very good problem-solving skills
- Experience with Web technologies is a plus
- Experience with ELK stack is a plus.
- Proficient in the development of Base Software in AUTOSAR.
- Experience in configuration of different AUTOSAR BSW components (Comms/DCM/DEM/Memory etc.)
- Experience working in any of the commercial AUTOSAR
NO SALES NO TARGET
English + Tamil/Kannada & Hindi
Good with communication
Reqiured Male candidates
Hsc/Grads Fresher can apply
Shift timing : 8am to 11pm (Any 9hrs shift)
Job Location : Malad west
who can join us spot
Job Position: JAVA Software Engineer
Job Location: Bangalore
Experience: 2 to 12 years
Job Responsibilities:
• Responsible for developing Web Applications using J2EE components.
• Responsible for developing standalone applications using Core Java and JDBC.
Desired Qualification: BE / B.Tech / MCA / MSc in Computer Science or IT
Added advantage: Sun Certified Java Programmer (SCJP), Sun Certified Web Component Developer (SCWCD) certification
Desired Skills:
- Strong skills in JAVA programming languages and focus specially on the following areas Servlets, JSP, Web Services, Struts framework, JDBC/JPA/mybatis (ibatis)/Hibernate, Threads, Collections and Design Patterns.
- Strong skills in web technologies HTML 4/5, JQuery, AJAX, Java Script and CSS.
- Thorough understanding of Object Orientation.
- Above average skills in SQL with familiarity in any of the standard RDBMS – MySQL, MSSQL or Oracle.
- Must have good written and oral communication in English language.
- Must be completely hands-on and an individual contributor and a self-starter; must be able to complete assignments (suitable to his/her experience) with minimal assistance.
- Very good at Analytical and Logical skills.
- Solid understanding of the web development lifecycle.
- Ability to learn quickly and deliver software on time.