Software Engineer - Core application Streaming

We are looking for a skilled and motivated Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems.

Key Responsibilities:

• Design, develop, test, and maintain scalable ETL data pipelines using Python.
• Work extensively on Google Cloud Platform (GCP) services such as:
• Dataflow for real-time and batch data processing
• Cloud Functions for lightweight serverless compute
• BigQuery for data warehousing and analytics
• Cloud Composer for orchestration of data workflows (based on Apache Airflow)
• Google Cloud Storage (GCS) for managing data at scale
• IAM for access control and security
• Cloud Run for containerized applications
• Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery.
• Implement and enforce data quality checks, validation rules, and monitoring.
• Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions.
• Manage version control using GitHub and participate in CI/CD pipeline deployments for data projects.
• Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or PostgreSQL.
• Document pipeline designs, data flow diagrams, and operational support procedures.
• 
  

Required Skills:

• 4–8 years of hands-on experience in Python for backend or data engineering projects.
• Strong understanding and working experience with GCP cloud services (especially Dataflow, BigQuery, Cloud Functions, Cloud Composer, etc.).
• Solid understanding of data pipeline architecture, data integration, and transformation techniques.
• Experience in working with version control systems like GitHub and knowledge of CI/CD practices.
• Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, PostgreSQL, etc.).

• Experience : 5-10 yrs
•  Past experience in working with any product start-up is a plus.
•  Proficiency in fundamental front end languages such as HTML, CSS, and JavaScript.
•  Familiarity with JavaScript frameworks such as Angular JS, React, and others.
•  Knowledge of Node.js and frameworks available for it such as Express (recommended).
•  Good understanding of asynchronous request handling, partial page updates, and AJAX
•  Understanding of REST Services.
•  Experience with Redis.
•  Familiarity with database technology such as MySQL, MongoDB and Elasticsearch.
•  Proficient understanding of serverless programming.
•  Proficient understanding of code versioning tools, such as Git.
•  Good problem-solving skills.
•  Attention to detail.

• Strong experience in Core Java, Multi-Threading, data structures (List/Map/Set) and unit testing
• with (Junit, Mockito)
•  Strong experience with Spring Framework (Spring MVC, Spring REST, Spring Data), ORM
• frameworks (JPA, Hibernate) and RDBMS (Oracle/MySQL/Postgres)
•  Strong experience in applying Object-Oriented design principles and Design Patterns
•  Good knowledge of Multi-Tier architecture, Micro Services architecture and Service Oriented
• Architecture 
•  Exposure to AWS Cloud, NoSQL Database (Mongo, Cassandra), Message Broker (Active
• MQ/RabbitMQ/Apache Kafka) and Big Data Technologies (Hadoop/Hive/Spark)
•  Additionally, must possess capability to review code, produce technical specification document
• and knowledge of code quality tools (PMD/FindBugs/Sonar)

Senior Developer should have exposure to building logistics products.

Skilled in RESTful & GraphQL APIs, microservices, and database optimization (MySQL, PostgreSQL, MongoDB).

• Experienced in authentication (OAuth, JWT), caching (Redis, Memcached), and real-time applications (WebSockets).

• Strong knowledge of CI/CD pipelines, Docker, Kubernetes, and cloud deployment (AWS, GCP, Azure).

• Passionate about scalability, performance tuning, security best practices, and clean code architecture.

• Developer will be responsible for managing back-end services and the interchange of data between the server and the users.

• Your primary focus will be the development of all server-side logic, definition and maintenance of the central database, and ensuring high performance and responsiveness to requests from the front-end.

• Knowledge of PHP web frameworks (Code igniter, Magento, Laravel etc).

• Should have experience in Word Press, Code igniter / Laravel or at-lease 1 MVC framework of PHP.

• Proficiency in HTML5, CSS3, and JavaScript JQuery.

• Good communication.

• Team worker.

• Ability to handle projects.

• Good problem-solving skills.

• Should be comfortable working in support with development projects
• Experience working on Spring (MVC, Boot, Batch, Security, Data)
• 4-5 years experience in Java-J2EE Development.
• Individual contributor.
• Extensive technical experience and development expertise in Core Java, J2EE.
• Experience working with and applying Design patterns to solve problems.
• Good in development code in Java/J2EE, new oracle query, procedures, functions, design the page, validate of java/Script
• Should be able to identify, track and mitigate risks to the product.

• Working knowledge of Node-Sync, callback hell and ways to control asynchronous behavior of Node functions.
• Strong command on ES6(EcmaScript) or Javascript and its concepts like prototypes, call back, closures etc
• Should have deep understanding of Native Node.js, Express.js, HAPI.js and middlewares.
• Candidates must have proper understanding and command on RESTful API development and consumptions.
• Candidates must know to use promises, async-await to control synchronization of business logic components.
• Candidates must have knowledge of JWT, oAuth and passport.js for user authentication.
• Candidates must have knowledge of GIT, Bit-bucket.
• Candidates must have knowledge of application deployment.
• Experience with NoSQL databases eg mongodb (preferred).

• You will hold the beacon for development and user experience at a company while helping us scale from 3 million users to 50 million users
• Build performance and effective new features by participating in the overall application lifecycle
• Build modular, reusable, performant, and optimal features both in frontend and backend
• Code, debug, troubleshoot, deliver
• Help maintain and improve existing data structures while planning and implementing new model data structures for scalability
• Continuously improve stability and performance of company’s tech platform
• Be the user’s voice and help make product decisions
• Exhibits knowledge and behavior to adopt Information Security and Privacy practices at their work.

• 1 - 4 years experience as a Full-Stack Developer
• In-depth understanding of the entire web development process (design, development, and deployment)
• Proficiency with Nodejs, MongoDB, AWS.
• Proficiency with front-end languages (e.g. HTML, JavaScript, and CSS)
• Team Building & Leadership
• Want to interact with all levels of the company including senior leaders and cross-functional teams
• Love problem solving and thrive on handling multiple projects and tasks
• Foster strong professional relationships with the full organization
• Sense of ownership and pride in your performance and its impact on the company’s success