Database Consultant-I (PostgreSQL)

Job Title : Data Engineer – GCP + Spark + DBT

Location : Bengaluru (On-site at Client Location | 3 Days WFO)

Experience : 8 to 12 Years

Level : Associate Architect

Type : Full-time

Job Overview :

We are looking for a seasoned Data Engineer to join the Data Platform Engineering team supporting a Unified Data Platform (UDP). This role requires hands-on expertise in DBT, GCP, BigQuery, and PySpark, with a solid foundation in CI/CD, data pipeline optimization, and agile delivery.

Mandatory Skills : GCP, DBT, Google Dataform, BigQuery, PySpark/Spark SQL, Advanced SQL, CI/CD, Git, Agile Methodologies.

Key Responsibilities :

• Design, build, and optimize scalable data pipelines using BigQuery, DBT, and PySpark.
• Leverage GCP-native services like Cloud Storage, Pub/Sub, Dataproc, Cloud Functions, and Composer for ETL/ELT workflows.
• Implement and maintain CI/CD for data engineering projects with Git-based version control.
• Collaborate with cross-functional teams including Infra, Security, and DataOps for reliable, secure, and high-quality data delivery.
• Lead code reviews, mentor junior engineers, and enforce best practices in data engineering.
• Participate in Agile sprints, backlog grooming, and Jira-based project tracking.

Must-Have Skills :

• Strong experience with DBT, Google Dataform, and BigQuery
• Hands-on expertise with PySpark/Spark SQL
• Proficient in GCP for data engineering workflows
• Solid knowledge of SQL optimization, Git, and CI/CD pipelines
• Agile team experience and strong problem-solving abilities

Nice-to-Have Skills :

• Familiarity with Databricks, Delta Lake, or Kafka
• Exposure to data observability and quality frameworks (e.g., Great Expectations, Soda)
• Knowledge of MDM patterns, Terraform, or IaC is a plus

Carsome’s Data Department is on the lookout for a Data Scientist/Data Science Lead who has a strong passion in building data powered products.

Data Science function under the Data Department has a responsibility for standardisation of methods, mentoring team of data science resources/interns, including code libraries and documentation, quality assurance of outputs, modeling techniques and statistics, leveraging a variety of technologies, open-source languages, and cloud computing platform. 

You will get to lead & implement projects such as price optimization/prediction, enabling iconic personalization experiences for our customer, inventory optimization etc.

Job Descriptions

• Identifying and integrating datasets that can be leveraged through our product and work closely with data engineering team to develop data products.
• Execute analytical experiments methodically to help solve various problems and make a true impact across functions such as operations, finance, logistics, marketing. 
• Identify, prioritize, and design testing opportunities that will inform algorithm enhancements. 
• Devise and utilize algorithms and models to mine big data stores, perform data and error analysis to improve models and clean and validate data for uniformity and accuracy.
• Unlock insights by analyzing large amounts of complex website traffic and transactional data. 
• Implement analytical models into production by collaborating with data analytics engineers.

Technical Requirements

• Expertise in model design, training, evaluation, and implementation ML Algorithm expertise K-nearest neighbors, Random Forests, Naive Bayes, Regression Models. PyTorch, TensorFlow, Keras, deep learning expertise, tSNE, gradient boosting expertise, regression implementation expertise, Python, Pyspark, SQL, R, AWS Sagemaker /personalize etc.
• Machine Learning / Data Science Certification

Experience & Education 

• Bachelor’s in Engineering / Master’s in Data Science  / Postgraduate Certificate in Data Science. 

The Sr AWS/Azure/GCP Databricks Data Engineer at Koantek will use comprehensive

modern data engineering techniques and methods with Advanced Analytics to support

business decisions for our clients. Your goal is to support the use of data-driven insights

to help our clients achieve business outcomes and objectives. You can collect, aggregate, and analyze structured/unstructured data from multiple internal and external sources and

patterns, insights, and trends to decision-makers. You will help design and build data

pipelines, data streams, reporting tools, information dashboards, data service APIs, data

generators, and other end-user information portals and insight tools. You will be a critical

part of the data supply chain, ensuring that stakeholders can access and manipulate data

for routine and ad hoc analysis to drive business outcomes using Advanced Analytics. You are expected to function as a productive member of a team, working and

communicating proactively with engineering peers, technical lead, project managers, product owners, and resource managers. Requirements:

 Strong experience as an AWS/Azure/GCP Data Engineer and must have

AWS/Azure/GCP Databricks experience.  Expert proficiency in Spark Scala, Python, and spark

 Must have data migration experience from on-prem to cloud

 Hands-on experience in Kinesis to process & analyze Stream Data, Event/IoT Hubs, and Cosmos

 In depth understanding of Azure/AWS/GCP cloud and Data lake and Analytics

solutions on Azure.  Expert level hands-on development Design and Develop applications on Databricks.  Extensive hands-on experience implementing data migration and data processing

using AWS/Azure/GCP services

 In depth understanding of Spark Architecture including Spark Streaming, Spark Core, Spark SQL, Data Frames, RDD caching, Spark MLib

 Hands-on experience with the Technology stack available in the industry for data

management, data ingestion, capture, processing, and curation: Kafka, StreamSets, Attunity, GoldenGate, Map Reduce, Hadoop, Hive, Hbase, Cassandra, Spark, Flume, Hive, Impala, etc

 Hands-on knowledge of data frameworks, data lakes and open-source projects such

asApache Spark, MLflow, and Delta Lake

 Good working knowledge of code versioning tools [such as Git, Bitbucket or SVN]

 Hands-on experience in using Spark SQL with various data sources like JSON, Parquet and Key Value Pair

 Experience preparing data for Data Science and Machine Learning with exposure to- model selection, model lifecycle, hyperparameter tuning, model serving, deep

learning, etc

 Demonstrated experience preparing data, automating and building data pipelines for

AI Use Cases (text, voice, image, IoT data etc. ).  Good to have programming language experience with. NET or Spark/Scala

 Experience in creating tables, partitioning, bucketing, loading and aggregating data

using Spark Scala, Spark SQL/PySpark

 Knowledge of AWS/Azure/GCP DevOps processes like CI/CD as well as Agile tools

and processes including Git, Jenkins, Jira, and Confluence

 Working experience with Visual Studio, PowerShell Scripting, and ARM templates.  Able to build ingestion to ADLS and enable BI layer for Analytics

 Strong understanding of Data Modeling and defining conceptual logical and physical

data models.  Big Data/analytics/information analysis/database management in the cloud

 IoT/event-driven/microservices in the cloud- Experience with private and public cloud

architectures, pros/cons, and migration considerations.  Ability to remain up to date with industry standards and technological advancements

that will enhance data quality and reliability to advance strategic initiatives

 Working knowledge of RESTful APIs, OAuth2 authorization framework and security

best practices for API Gateways

 Guide customers in transforming big data projects, including development and

deployment of big data and AI applications

 Guide customers on Data engineering best practices, provide proof of concept, architect solutions and collaborate when needed

 2+ years of hands-on experience designing and implementing multi-tenant solutions

using AWS/Azure/GCP Databricks for data governance, data pipelines for near real-

time data warehouse, and machine learning solutions.  Over all 5+ years' experience in a software development, data engineering, or data

analytics field using Python, PySpark, Scala, Spark, Java, or equivalent technologies.  hands-on expertise in Apache SparkTM (Scala or Python)

 3+ years of experience working in query tuning, performance tuning, troubleshooting, and debugging Spark and other big data solutions.  Bachelor's or Master's degree in Big Data, Computer Science, Engineering, Mathematics, or similar area of study or equivalent work experience

 Ability to manage competing priorities in a fast-paced environment

 Ability to resolve issues

 Basic experience with or knowledge of agile methodologies

 AWS Certified: Solutions Architect Professional

 Databricks Certified Associate Developer for Apache Spark

 Microsoft Certified: Azure Data Engineer Associate

 GCP Certified: Professional Google Cloud Certified

Gather requirements by identifying user needs and recommend solution to clients.

Develop user requirement document, functional specification, user guide and training material for solutions.

Act as a liaison between development team and stakeholder throughout the implementation.

Support implementation, user acceptance testing and training activities (when required).

Analyzing, developing and proposing enhancements to current business processes, reports and applications in order to optimize system effectiveness.

Provide support in pre-sales activities with sales and marketing team, activities included analysis on RFP, provide business proposal, conduct system demo.

What you’ll need?

Candidate must at least possess a Bachelor’s Degree in IT and Business majors preferred.

Prefer a minimum of 2 years’ experience analyzing business requirements and translating them into functional requirements but fresh graduate is encouraged to apply.

Must possess good knowledge of the software development life cycle (SDLC), practical understanding of information technology and have the ability to conceptually relate technology to business’ needs.

Effective communication skills to collaborate with stakeholders and technical teams.

Retail domain knowledge would be a strong advantage.

Our growing Web 3 media company is looking for an experienced and ambitious Business Development Executive responsible for building new opportunities with existing/new clients.

Requirements:

• A minimum of 3-4 years of work experience in the crypto, Web 3, and blockchain industry with an understanding of the digital ads space, along with branded content sales.

• The ability to up-sell to existing clients and discover new potential brands to collaborate with. Actively pitching to clients or advertisers and presenting them with creative brand solutions. Monitor, analyze sales, and market trends, and develop an effective strategic sales plan.

• Will be responsible for driving revenue, growth & customer satisfaction. Provide leadership to the brand partnerships department's day-to-day operations while focusing on the company’s strategic goals.

• The ability and agility to switch between tasks and priorities without losing focus or speed. Work with internal teams across content, ad-ops, and data to create compelling solutions for clients including rollout plans, budgets, logistics, etc.

Good to have:

• The ability to work in a structured manner as the team scales equally depending on processes and people.

• Attention to detail — in everything. Champions ad space, properties, and campaigns internally to help drive revenue further.

• Needs to have strong contacts and relationships in the industry across clients and agencies like ad networks, direct media buyers, crypto exchanges, wallets, Coins, etc.

Benefits at CoinGape:

• Working in a cutting-edge field of Crypto & Blockchain.
• Huge responsibilities from Day 1. Be the owner of your own learning curve.
• The possibilities are limitless and depend on you. You get to work in a very dynamic environment.

Responsibilities

• Employ user-centered design practices to deliver extraordinary interactive game experiences
• Research the latest practices & industry standards from the Top notch games to create world-class immersive experience for players
• Evaluate designs quickly and craft creative high quality work
• Excellent understanding of visual design principles, style guidelines, design processes, and creative workflow
• Develop UI, graphic design, and interaction specifications/guidelines
• Ability to take on design problems independently, present and sell design concepts
• Finding creative ways to solve UX problems.
• Interface, and collaborate with key stakeholders to ensure the user experience reflects player needs and consistency.

Required Skills

• 3-5 years experience in UX Design.
• Expert-level skills in Adobe Photoshop and industry-standard prototyping tools such as Adobe XD, and Figma. 
• Experience in mobile interface design
• Strong portfolio of design projects.
• Hands-on experience or knowledge of Unity 3D and motion design is a plus.
• Excellent written and verbal communication
• Real passion for gaming
• Bachelor’s degree in graphic arts, interaction design, or equivalent industry experience in the design field.

Ready to work without a handbook, with a love for doing what’s never been done before!

You should apply if you have —

1. 3 - 5 years of technical experience (you can count internships & freelance work towards this).
2. Proficiency in React (especially Hooks) and Typescript; experience in Node.js is nice to have.
3. Experience in profiling apps for performance.
4. A track record of writing accessible and detailed version-control commits, documentation and code reviews.
5. A strong ability to write clean, scalable, self-documenting & highly-testable code.
6. Very good problem-solving skills.

You'll be helping us with some of these challenges —

1. How do we keep building more features while keeping the code clean, as small as possible and highly performant?
2. How do we build a strong testing-first delivery cycle so we can ship code with greater confidence?

We're problem-solvers at heart, and we value data-driven decision-making. We believe in high-quality execution, crafting great user experiences, honest & transparent communication and enabling our people to thrive and be the best version of themselves.

The early engineering + product team includes folks from https://home.lynk.co.in/" target="_blank">Lynk,Zoho and https://www.kilobytetech.com/" target="_blank">Kilobyte, and we're hoping to build one of the best teams in the city; kind & compassionate, diverse and smart — one you can be proud for being a part of.

We're all generalists and prefer picking the right tool for the job. That said, we do use a lot of new & exciting technology.

Backend

• Golang for most services and Node.js (https://koajs.com/" target="_blank">Koa, https://github.com/lukeed/polka#polka" target="_blank">Polka) for a few
• gRPC for inter-service communication
• PostgreSQL

Frontend

• 100% TypeScript
• React v17 & https://nextjs.org/" target="_blank">Next.js v10
• https://github.com/pmndrs/zustand#readme" target="_blank">Zustand
• https://chakra-ui.com/" target="_blank">Chakra-UI
• https://www.framer.com/motion/" target="_blank">Framer Motion
• https://storybook.js.org/" target="_blank">Storybook
• https://maizzle.com/" target="_blank">Maizzle

Infra

• AWS (with extensive use of RDS, S3, ECS, SQS, SES & CloudWatch)
• Gitlab for version-control and CI/CD
• All apps built and shipped as Docker images
• Kubernetes for container orchestration
• https://www.honeybadger.io/" target="_blank">Honeybadger for error analytics & uptime monitoring

* B.E. , B.Tech ,MCA or other equivalent engineering degree

* Total Exp: 1-4 years

* Minimum 2 year relevant experience in .Net or .Net core server-side programming as last

working relevant experience.

* Basic Engineering Knowledge – OOPS , Data Structure , memory management etc..

* Hands on experience in .Net, WCF (optional) and windows concept

* Hands on experience in SQL – basic are must to have

* Requirement analysis and design principle understanding is required

* Good in unit testing and debugging concepts

* Should be good in communication.