
Lead II - Data Engineering -Python - Databricks, PySpark, Python
at Global digital transformation solutions provider.
Role Proficiency:
This role requires proficiency in developing data pipelines including coding and testing for ingesting wrangling transforming and joining data from various sources. The ideal candidate should be adept in ETL tools like Informatica Glue Databricks and DataProc with strong coding skills in Python PySpark and SQL. This position demands independence and proficiency across various data domains. Expertise in data warehousing solutions such as Snowflake BigQuery Lakehouse and Delta Lake is essential including the ability to calculate processing costs and address performance issues. A solid understanding of DevOps and infrastructure needs is also required.
Skill Examples:
- Proficiency in SQL Python or other programming languages used for data manipulation.
- Experience with ETL tools such as Apache Airflow Talend Informatica AWS Glue Dataproc and Azure ADF.
- Hands-on experience with cloud platforms like AWS Azure or Google Cloud particularly with data-related services (e.g. AWS Glue BigQuery).
- Conduct tests on data pipelines and evaluate results against data quality and performance specifications.
- Experience in performance tuning.
- Experience in data warehouse design and cost improvements.
- Apply and optimize data models for efficient storage retrieval and processing of large datasets.
- Communicate and explain design/development aspects to customers.
- Estimate time and resource requirements for developing/debugging features/components.
- Participate in RFP responses and solutioning.
- Mentor team members and guide them in relevant upskilling and certification.
Knowledge Examples:
- Knowledge of various ETL services used by cloud providers including Apache PySpark AWS Glue GCP DataProc/Dataflow Azure ADF and ADLF.
- Proficient in SQL for analytics and windowing functions.
- Understanding of data schemas and models.
- Familiarity with domain-related data.
- Knowledge of data warehouse optimization techniques.
- Understanding of data security concepts.
- Awareness of patterns frameworks and automation practices.
Additional Comments:
# of Resources: 22 Role(s): Technical Role Location(s): India Planned Start Date: 1/1/2026 Planned End Date: 6/30/2026
Project Overview:
Role Scope / Deliverables: We are seeking highly skilled Data Engineer with strong experience in Databricks, PySpark, Python, SQL, and AWS to join our data engineering team on or before 1st week of Dec, 2025.
The candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and analytics solutions that drive business insights and operational efficiency.
Design, build, and maintain scalable data pipelines using Databricks and PySpark.
Develop and optimize complex SQL queries for data extraction, transformation, and analysis.
Implement data integration solutions across multiple AWS services (S3, Glue, Lambda, Redshift, EMR, etc.).
Collaborate with analytics, data science, and business teams to deliver clean, reliable, and timely datasets.
Ensure data quality, performance, and reliability across data workflows.
Participate in code reviews, data architecture discussions, and performance optimization initiatives.
Support migration and modernization efforts for legacy data systems to modern cloud-based solutions.
Key Skills:
Hands-on experience with Databricks, PySpark & Python for building ETL/ELT pipelines.
Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).
Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).
Experience with data modeling, schema design, and performance optimization.
Familiarity with CI/CD pipelines, version control (Git), and workflow orchestration (Airflow preferred).
Excellent problem-solving, communication, and collaboration skills.
Skills: Databricks, Pyspark & Python, Sql, Aws Services
Must-Haves
Python/PySpark (5+ years), SQL (5+ years), Databricks (3+ years), AWS Services (3+ years), ETL tools (Informatica, Glue, DataProc) (3+ years)
Hands-on experience with Databricks, PySpark & Python for ETL/ELT pipelines.
Proficiency in SQL (performance tuning, complex joins, CTEs, window functions).
Strong understanding of AWS services (S3, Glue, Lambda, Redshift, CloudWatch, etc.).
Experience with data modeling, schema design, and performance optimization.
Familiarity with CI/CD pipelines, Git, and workflow orchestration (Airflow preferred).
******
Notice period - Immediate to 15 days
Location: Bangalore

Similar jobs
Job Location: Mumbai
Key Responsibilities
1. Financial Strategy & Leadership
Develop and execute financial strategies aligned with company growth objectives
Partner with CEO and leadership team on business expansion, investments, and risk management
Provide financial insights to support strategic decision-making
2. Financial Planning & Analysis (FP&A)
Lead budgeting, forecasting, and financial modeling processes
Monitor project-wise profitability and cost performance
Analyze variances and recommend corrective actions
Drive margin improvement across projects
3. Project Accounting & Cost Control
Oversee project costing, revenue recognition (percentage of completion method), and billing
Ensure accurate tracking of:
BOQs (Bill of Quantities)
Variations and change orders
Material and labour costs
Implement strong cost control mechanisms for facade projects
4. Treasury & Cash Flow Management
Manage cash flow, working capital, and liquidity planning
Oversee banking relationships, including:
Bank Guarantees (BGs)
Letters of Credit (LCs)
Project financing
Optimize fund utilization and reduce finance costs
5. Accounting & Compliance
Ensure accurate and timely financial reporting as per applicable standards
Oversee audits, taxation (GST, Income Tax), and statutory compliance
Maintain strong internal controls and governance frameworks
Ensure compliance with contract terms and financial regulations
6. Risk Management
Identify financial and operational risks in projects and contracts
Evaluate contract terms for financial exposure
Implement mitigation strategies for cost overruns, delays, and claims
7. Commercial & Contract Management
Review contracts for commercial viability and risk
Support negotiation of project terms, payment milestones, and escalation clauses
Monitor receivables and ensure timely collections
8. Team Leadership
Lead and mentor finance, accounts, and commercial teams
Build systems, processes, and SOPs for scalability
Drive automation and ERP implementation (if required)
Key Requirements
Education
CA / CPA / MBA (Finance) or equivalent qualification
Experience
10–18+ years in finance, with at least 5 years in a leadership role
Strong experience in construction, facade, EPC, or project-based industries
Proven expertise in project accounting and contract management
Skills & Competencies
Strong financial acumen and strategic thinking
Expertise in cost control and margin management
Knowledge of BGs, LCs, and project financing
Excellent leadership and stakeholder management skills
High proficiency in ERP systems and financial tools
Key Performance Indicators (KPIs)
Project profitability and margin improvement
Cash flow and working capital efficiency
Reduction in cost overruns
Timely financial reporting and compliance
Receivables cycle and collection efficiency
Assist in developing architectural concepts, presentations, and design drawings.
Support in preparing detailed plans, sections, elevations, and 3D models.
Conduct site visits, surveys, and assist in documenting site conditions.
Coordinate with consultants, vendors, and internal teams for accurate design development.
Ensure drawings comply with local building codes and standards.
Assist in preparation of BOQs, material selections, and design documentation.
Participate in client meetings and help translate requirements into design solutions.
Support project planning, documentation, and revisions as required.
Required Skills & Qualifications
Bachelor’s degree in Architecture (B.Arch) from a recognized institution.
Proficiency in Autocad, SketchUp, Revit and MS Office.
Strong understanding of architectural design principles and construction basics.
Good visualization, detailing, and presentation skills.
Ability to learn quickly and work collaboratively within a team.
Strong communication and time management abilities.
Company Description
TECHSOPHY specializes in productizing solutions based on new technology, focusing on emerging platforms of BPM & ECM, Low Code, AI (ML/RPA/NLP). Founded in 2009, TECHSOPHY operates with headquarters in California, USA, and regional offices in Dubai, UAE, and an offshore innovation center in Hyderabad, India.
Qualifications
- Solid Fundamentals and exceptional problem-solving skills
- Solid and fluent understanding of algorithms and data structures
- Proficiency in Scala + Spark
- Proficiency in Scala + Play framework
- Experience Range: 4 to 7 Years
Requirement:
Some or all of them – because we believe intelligent people can pick up whatever they need in a short period of time. You just need to prove that you can:
- Excellent programming skills and knowledge of Java / Scala
- Excellent software design, problem-solving, and debugging skills
- Experience with modern Big Data technologies such as Spark, NoSQL, Cassandra, Kafka, MapReduce, and the Hadoop ecosystem is a must-have
- Experience with data analytics and the ability to mine data to obtain insights are much appreciated
Experience - 7 to 8 Years
Location - Remote
Shift - US Shift (Timing 7pm to 3am IST OR 8pm to 4am IST)
Notice Period – Immediate/ 15 Days/ 1 month
Job Description:
We are looking for a Java developer experienced in developing microservices using a framework such as Quarkus, Micronaut or Spring Boot. Your primary responsibility will be to implement these microservices to a high level of quality.
Responsibilities:
- Create REST APIs to specification.
- Create documentation for the individual microservices.
Technologies:
JAVA 8, J2EE, Spring, Spring Boot, Spring Data JPA, Tomcat, SHELL Script, Hibernate, etc
Skills:
- Strong Understanding of Microservice Architecture
- Minimum 6 years of Proven/ Implementation experience in developing and deploying microservices.
- Experience working on J2EE based applications.
- Experience in performing Technical Assessment of current state of systems/ Debugging.
- Good skills in debugging.
- Strong in development of Spring Boot and Spring applications.
- Strong in development of Restful API using JAX-RS and JSON
- Good knowledge possibly experienced with AWS components like S3, Lambda, API Gateway,
- Dynamo DB, CloudWatch.
Roles & Responsibilities:
- Define and lead strategic performance projects, manage stakeholders to drive outcomes.
- Analyzing and presenting key MIS reports for Management review
- Lead business planning for including formulation of annual, monthly and daily plans on key
- performance metrics.
- Driving the strategic initiatives of the company as per the CEO's agenda
- Studying & improvising the operation processes of the company.
- Drive business performance insights working closely with the sales, marketing, growth &analytics teams
- Create strategic value-added analyses around growth opportunities, retention levers and core
- business metrics in order to drive better decision making and results
- Conduct ongoing analysis of key business drivers, trends and performance.
Requirements:
· Bachelor's degree in Computer Science, Software Engineering, or related field (or equivalent experience).
· Minimum of 4 years of professional Python development experience.
· Strong expertise in Django framework and its ecosystem.
· Proficiency in web development technologies such as HTML, CSS, JavaScript, and front-end frameworks.
· Experience with database systems like PostgreSQL, MySQL, or MongoDB.
· Knowledge of RESTful API design and integration.
· Familiarity with version control systems, especially Git.
· Excellent problem-solving and debugging skills.
· Strong communication and collaboration skills.
· Self-motivated and able to work independently or in a team.
· Experience with React.js and Docker is a plus.
Job Brief:
- Review requirements, specifications, and technical design documents to provide timely and meaningful feedback
- Create detailed, comprehensive, and well-structured test plans and test cases
- Estimate, prioritize, plan and coordinate testing activities
- Design, develop and execute automation scripts using open source tools
- Identify, record, document thoroughly, and track bugs
- Perform thorough regression testing when bugs are resolved
- Develop and apply testing processes for new and existing products to meet client needs
- Liaise with internal teams (e.g. developers and product managers) to identify system requirements
- Monitor debugging process results
- Investigate the causes of non-conforming software and train users to implement solutions
- Track quality assurance metrics, like defect densities and open defect counts
- Stay up-to-date with new testing tools and test strategies
- The exciting part of joining our organization is here for you. Once you complete a career span of 1year and above in our company based on your performance, you will get an opportunity to work in our onshore office in "Australia".
Develop new user-facing features
Translation of the UI/UX design wireframes to actual code that will produce visual elements of the application.
Optimize application for maximum speed and scalability
Ensuring that the web components are responsive, reliable, adaptable, and consistent.
Optimizing components for easy usability while maintaining a professional design.
Proficient understanding of cross-browser compatibility issues and ways to work around them.
Optimize application for maximum speed and scalability.
Qualifications:
2+ years of experience in Angular + AngularJS.
An excellent understanding of Angular + AngularJS.
Proficient in writing complex mixins + CSS.
Good Knowledge of Version control tools like Git, SVN, etc.
Good understanding of VueJS / ReactJS.
Proficient in JS + HTML development.
Good knowledge of PHP would be preferred.
ASP.net core , MVC , *ASP.net core, MySql
MS SQL
*Angular 4 above
* oops concepts
* java script, case, and HTML exp in agile like scrum.
LOCATION- PUNE
Currently work from home.
Job Type: Full-time
Hiring for UK Education Campaign -
Interview process Remote.
Key Points for Job Seekers (Why should you join CogentHub)
Lead Generation;
No Sales;
Fixed Salary Date;
Home Drop facility (Pickup as per COVID Situation).
Paid Training Sessions;
Fixed shift timings / No stretch;
Fixed 6 days working
Daily & Monthly Incentives;
Best Pay package in the Industry.
Required:
Excellent English Communication Skills
Basic Computer Knowledge
Full Time Job in Voice Process
Preferred Experience 6 months to 1 Year in any International BPO domain
Job Descriptions:
- You have to deal with UK B2C customers for Lead Generation process.
Facilities:
Fixed Office Timings - (3:00pm- 12.00 am midnight)
Attractive Salary Packages (Fixed Salary)
Salary on Time
Free Home Drop Facility (as per the Transport Boundary)
Huge Daily & Monthly Incentives.
6 Days Working
Our Address:
Cogent Hub Private Limited
Udyog Vihar, Gurugram - 122016










