Lead Data Engineer at Discite Analytics Private Limited · Ahmedabad · 4 - 7 years · ₹12L - ₹20L / yr (ESOP available) · Raised funding · Posted 1 Nov 2021
Python
Java
Scala
C++
PostgreSQL
MongoDB
Amazon Web Services (AWS)1. Communicate with the clients and understand their business requirements.
2. Build, train, and manage your own team of junior data engineers.
3. Assemble large, complex data sets that meet the client’s business requirements.
4. Identify, design and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
5. Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources, including the cloud.
6. Assist clients with data-related technical issues and support their data infrastructure requirements.
7. Work with data scientists and analytics experts to strive for greater functionality.
Skills required: (experience with at least most of these)
1. Experience with Big Data tools-Hadoop, Spark, Apache Beam, Kafka etc.
2. Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc.
3. Experience in ETL and Data Warehousing.
4. Experience and firm understanding of relational and non-relational databases like MySQL, MS SQL Server, Postgres, MongoDB, Cassandra etc.
5. Experience with cloud platforms like AWS, GCP and Azure.
6. Experience with workflow management using tools like Apache Airflow.
Shubham Vishwakarma
Full Stack Developer - Averlon
About Discite Analytics Private Limited
About
Discite Analytics & AI is a AI/ML and Data Engineering firm that specializes in creating custom solutions and products for companies of all sizes worldwide. Founded in 2020 by Kunal Singh, a former Uber executive, the company is committed to providing in-depth knowledge of their clients' business and operations to create the best solutions for SMEs.
At Discite Analytics & AI, we invest time interacting with end-users within our clients' companies, not just CXOs, to understand their data requirements fully. We offer a wide range of services, including conducting market research, setting up data pipelines, creating live dashboards, and building machine learning/artificial intelligence solutions to ensure our clients stay ahead of their competition with data-driven decision-making.
Connect with the team
Company social profiles
Similar jobs (10)
Job Summary
We are seeking a highly skilled GCP Data Engineer with strong expertise in Google Cloud Platform (GCP), Python, ETL, and modern data engineering technologies. The ideal candidate should have hands-on experience designing and building scalable data pipelines using BigQuery, Dataflow, Pub/Sub, Airflow, and modern data lake technologies such as Apache Iceberg or Delta Lake.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT data pipelines on Google Cloud Platform.
- Build and optimize data processing workflows using Python and Google Cloud Dataflow (Apache Beam).
- Develop and manage large-scale analytical data models in BigQuery.
- Implement event-driven data ingestion using Google Cloud Pub/Sub.
- Create, schedule, and monitor workflows using Apache Airflow and Autosys.
- Design and implement modern data lake architectures using Apache Iceberg or Delta Lake.
- Optimize query performance, storage, and compute costs in GCP.
- Ensure data quality, governance, security, and compliance across data platforms.
- Collaborate with Data Scientists, Analysts, and Application teams to deliver scalable data solutions.
- Troubleshoot production issues and continuously improve pipeline reliability and performance.
Mandatory Skills
- Strong hands-on experience with Google Cloud Platform (GCP).
- Proficiency in Python programming.
- Experience in designing and implementing ETL/ELT pipelines.
- Strong knowledge of BigQuery.
- Experience with Google Cloud Dataflow (Apache Beam).
- Experience with Google Cloud Pub/Sub.
- Hands-on experience with Apache Airflow.
- Experience in job scheduling using Autosys.
- Experience with modern table formats such as Apache Iceberg or Delta Lake.
- Strong SQL and data modeling skills.
Preferred Skills
- Experience with Cloud Storage, Dataproc, Cloud Composer, and Cloud Functions.
- Knowledge of CI/CD pipelines and DevOps practices.
- Experience with Docker and Kubernetes.
- Familiarity with Git and Agile/Scrum methodologies.
- Knowledge of data warehousing and dimensional modeling.
- Exposure to streaming and real-time data processing.
Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- 4–8+ years of experience in Data Engineering with hands-on expertise in GCP technologies.
Required Experience
- Strong experience in developing enterprise-grade data pipelines using Python and GCP.
- Hands-on experience with BigQuery, Dataflow, Pub/Sub, and Airflow.
- Experience scheduling and monitoring batch workflows using Autosys.
- Experience implementing modern data lake architectures using Apache Iceberg or Delta Lake.
- Strong understanding of ETL best practices, performance tuning, and data optimization.
- Excellent analytical, troubleshooting, and problem-solving skills.
Mandatory Skills
- Google Cloud Platform (GCP)
- Python
- ETL
- BigQuery
- Autosys
- Apache Airflow
- Google Cloud Pub/Sub
- Google Cloud Dataflow (Apache Beam)
- Apache Iceberg / Delta Lake
- SQL & Data Modeling
JavascriptMandatory Criteria
- Looking for candidates from Bangalore and NP less than or equal to 20 days
- Bachelor’s degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- 6+ years of experience in quality assurance or software testing, with at least 3 years focused on test automation and 2+ years in a leadership or senior role.
- Solid knowledge of SQL Experience in architecting and implementing automated testing frameworks . Strong in programming/scripting languages such as Python, Java, or JavaScript for automation development.
- Expertise with automation tools like Selenium, Playwright, Appium, or RestAssured, and integrating them into CI/CD workflows.
- Proven leadership skills, including mentoring junior engineers and managing team deliverables in an agile environment.
- Experience with test management tools (e.g., TestRail, qTest) and defect tracking systems (e.g., Jira).
- Deep understanding of testing best practices, including functional, regression, performance, and security testing.
- Ability to analyze system architecture and identify key areas for test coverage and risk mitigation.
- Experience with containerization technologies (Docker, Kubernetes) and cloud platforms (AWS preferred). Understanding of performance, security, and load testing tools (e.g., JMeter, OWASP ZAP).
- Familiarity with observability and monitoring tools (e.g., ELK Stack, Datadog, Prometheus, Grafana) for test environment analysis.
If interested kindly share your updated resume on 82008 31681
Dear Candidate,
We are urgently looking for a Release- Big data Engineer For Pune Location.
Experience : 5-8 yrs
Location : Pune
Skills: Big data Engineer , Release Engineer ,DevOps, Aws/Azure/GCP Cloud exp. ,
JD:
- Oversee the end-to-end release lifecycle, from planning to post-production monitoring. Coordinate with cross-functional teams (DBA, BizOps, DevOps, DNS).
- Partner with development teams to resolve technical challenges in deployment and automation test runs
- Work with shared services DBA teams for schema-based multi-tenancy designs and smooth migrations.
- Drive automation for batch deployments and DR exercises. YAML based micro service deployment using shell/Python/Go
- Provide oversight for Big Data toolsets for deployment (e.g., Spark, Hive, HBase) in private cloud and public cloud CDP environments
- Ensure high-quality releases with a focus on stability and long-term performance.
- Able to run the automation batch scripts and debug the deployment and functional aspects/ work with dev leads to resolve the release cycle issues.
Regards,
Minakshi Soni
Executive- Talent Acquisition
Rigel Networks
- Gathering information and documentation from clients
- Helping clients fill out immigration application forms
- Drafting submission letters
- Reviewing all documents to ensure they are accurate and meet government requirements
- Ensuring that deadlines are met
- Tracking the status of each application and keeping clients updated
About the company:
Our client , A leading fin-tech brand , is on a mission to build financial services that are simple, accessible and affordable. Founded by one of the pioneers of E-commerce in India , the brand aims to build consumer-centric & technology driven businesses in the BFSI (Banking, Financial Services & Insurance) space. The brand is currently disrupting Lending, Insurance and Mutual Funds market
Please share with us a portfolio of your work in addition to your updated CV while applying for this position.
Responsibilities
– Handle video editing requirements within deadlines from multiple teams.
– Taking ownership of video projects and providing inputs to overall video plan.
– Closely working with other teams for creative and technical inputs when it comes to videos.
– Experience in directing skilled and unskilled actors as required while majorly contributing in overall video shooting and production.
Requirements
– 4+ years experience as a video editor delivering high-quality videos (multiple formats) within tight deadlines.
– Extensive knowledge about Adobe Creative Suite.
– Experience in design, motion graphics, and audio editing.
– Excellent verbal and written communication skills in English.
– Self-starter with demonstrated initiative.
– Experience of working within brand guidelines.
– Highly creative with detail-oriented thinking.
– Experience of working with an agency (if required) an added bonus.
Qualifications
Graduate in any discipline. Degree in film studies, editing or related fields to be given priority.
Hiring fresher's for role of “Customer Delivery Manager” for one of the leading product based company in telecom analytics servicing.
Perks:-
- Exciting opportunity to kick start career in leading telecom analytics solutions with worldwide customers & clients.
- Lucrative compensation at fresher’s level with attractive additional bonus
- Chance to travel as part of the work
- Great platform to learn, earn, deliver & grow in the telecom industry.
- Multiple Vacancies, thus higher chance of selection with on the spot offer.
Work responsibilities expected:
- Learning & understanding about company’s products, Digital and build knowledge that allows optimum deployments.
- Get trained on the standard and cloud deployment methodologies and practices and application of the same in the projects assigned.
- Optimal grievance handling & servicing on client requirements/queries, through best approach.
- Beforehand anticipation of situations, drawbacks and complaints & delivering adequate and timely solutions with premium customer satisfaction.
Desired Profile:
- Bachelor’s Degree in Computer/Telecommunications/E&E Engineering or equivalent with min 65% in final year.
- Strong communication skill. Good listener and really good at articulation of issues/discussion at hand.
- Solid organizational skills including attention to detail, multitasking skills, efficiency, agility.
- Strong understanding of Linux, Scripting, DevOps, SQL is a must. DevOps understanding will be an added plus.
PHP
Laravel- Proficient with Laravel/CI/Node.JS/Yii
- Must have at least 1 year of experience
- Able to join office
Interview Process:
- Initial Screening
- Telephonic Interview
- Machine Test
- HR Round
React.js
HTML/CSSJavascriptSenior Frontend Developer || CSS, HTML, JavaScript, React.js|| 3+ years exp
|
· Minimum 3+ years of relevant experience · 3+yrs Exp in React.js (Mandatory) · Traits & culture: Entrepreneurial & willing go the extra mile. · Strong knowledge and experience in HTML, CSS, and JavaScript is a must. · Experience developing front-end interfaces by leveraging modern development libraries and tool chains like React, Webpack, etc... · Deep understanding of DOM, Rendering and how the browser works. · Experience building web-based user interfaces for mobile and desktop. · Experience in writing modular and reusable code. · Solid understanding of software development methodologies and processes. · Experience in building fast, fluid, beautiful user experiences and driving growth in consumer websites and web applications. · You are generally curious/interested in tech, motivated, creative/entrepreneurial, energetic, humble and hard-working · Most important - willing to go that extra mile to get the work done. · Bonus points for experience working on Node.js :)
Working days: Mon - Sat (2nd & 4th Sat off) |
Responsibilities and Duties
1.Create, categorize and refine keyword lists to create a comprehensive campaign that drives qualified visitors to our site
- Perform management of PPC accounts on Google AdWords, Yahoo, Bing, and other search platforms for a variety of clients.
- Assist in the maintenance and monitoring of keyword bids, budget caps, and other important account metrics.
- Create online banner adverts and oversee pay per click (PPC) ad management
- Track and analyze website traffic flow and provide regular internal reports
- Manage and maintain updates for keyword lists.
- Provide recommendations and execute strategies for keyword opportunities, campaign structuring, targeting,
display network, and other facets of paid search in accordance with client goals.
- Familiarity with Google Adwords reporting interface
Job Requirements:
- Experience in Search Engine Optimizations (SEO) Search Engine Marketing (SEM) and Paid Search (PPC).
- Proficiency in MS Office
- Experience working with AdWords and Bing Ads
- AdWords certification required
- Ads 360 experience (previously Double-click Search)
- BS/BA degree preferred
- Agency experience preferred
- High proficiency with Google Analytics, Bing Analytics, and other website analytics software
Java
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon