Cutshort logo
Fragma Data Systems logo
Data Engineer (PySpark+SQL)
Data Engineer (PySpark+SQL)
Fragma Data Systems's logo

Data Engineer (PySpark+SQL)

Evelyn Charles's profile picture
Posted by Evelyn Charles
3.5 - 8 yrs
₹5L - ₹18L / yr
Remote, Bengaluru (Bangalore)
Skills
PySpark
Data engineering
Data Warehouse (DWH)
SQL
Spark
PowerBI
Must-Have Skills:
• Good experience in Pyspark - Including Dataframe core functions and Spark SQL
• Good experience in SQL DBs - Be able to write queries including fair complexity.
• Should have excellent experience in Big Data programming for data transformation and aggregations
• Good at ELT architecture. Business rules processing and data extraction from Data Lake into data streams for business consumption.
• Good customer communication.
• Good Analytical skill
 
 
Technology Skills (Good to Have):
  • Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub.
  • Experience in migrating on-premise data warehouses to data platforms on AZURE cloud. 
  • Designing and implementing data engineering, ingestion, and transformation functions
  • Azure Synapse or Azure SQL data warehouse
  • Spark on Azure is available in HD insights and data bricks
 
Good to Have: 
  • Experience with Azure Analysis Services
  • Experience in Power BI
  • Experience with third-party solutions like Attunity/Stream sets, Informatica
  • Experience with PreSales activities (Responding to RFPs, Executing Quick POCs)
  • Capacity Planning and Performance Tuning on Azure Stack and Spark.
Read more
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos

About Fragma Data Systems

Founded :
2015
Type :
Products & Services
Size :
100-1000
Stage :
Profitable

About

Fragma is a leading Big data, AI and Advanced analytics company provideing services global clients.

Read more

Connect with the team

Profile picture
Mallikarjun Degul
Profile picture
Sandhya JD
Profile picture
Varun Reddy
Profile picture
Priyanka U
Profile picture
Simpy kumari
Profile picture
Minakshi Kumari
Profile picture
Latha Yuvaraj
Profile picture
Vamsikrishna G

Company social profiles

bloglinkedintwitter

Similar jobs

Indore
2 - 6 yrs
₹4L - ₹8L / yr
skill iconMongoDB
skill iconReact.js
skill iconNodeJS (Node.js)
skill iconExpress
DevOps
+2 more

Key Responsibilities & Skills


Strong hands-on experience in React.js, Node.js, Express.js, MongoDB

Ability to lead and mentor a development team

Project ownership – sprint planning, code reviews, task allocation

Excellent communication skills for client interactions

Strong decision-making & problem-solving abilities


Nice-to-Have (Bonus Skills)


Experience in system architecture design

Deployment knowledge – AWS / DigitalOcean / Cloud

Understanding of CI/CD pipelines & best coding practices


Why Join InfoSparkles?


Lead from Day One

Work on modern & challenging tech projects

Excellent career growth in a leadership position

Read more
Infozub Private Limited
Tirupur, Palladam
0 - 1 yrs
₹1.8L - ₹2.6L / yr
Adobe Photoshop
skill iconAdobe Illustrator
Adobe Premiere Pro
Adobe After Effects

Key Responsibilities:

  • Design engaging graphics for social media, advertisements, websites, and print materials.
  • Collaborate with the marketing and content teams to develop creative concepts and campaigns.
  • Create logos, banners, posters, and other branding materials.
  • Edit and retouch product or model images when needed.
  • Ensure consistency with brand identity and visual guidelines.
  • Stay updated with the latest design trends and tools.

Requirements:

  • 1 year of proven experience as a graphic designer.
  • Proficiency in Adobe Illustrator and Adobe Photoshop (knowledge of After Effects or Premiere Pro is a plus).
  • Strong understanding of colour theory, typography, and layout design.
  • Ability to work on multiple projects and meet deadlines.
  • Attention to detail and creativity.


Read more
Deqode
at Deqode
1 recruiter
Roshni Maji
Posted by Roshni Maji
Pune, Bengaluru (Bangalore), Gurugram, Chennai, Mumbai
5 - 7 yrs
₹6L - ₹20L / yr
skill iconAmazon Web Services (AWS)
Amazon Redshift
AWS Glue
skill iconPython
PySpark

Position: AWS Data Engineer

Experience: 5 to 7 Years

Location: Bengaluru, Pune, Chennai, Mumbai, Gurugram

Work Mode: Hybrid (3 days work from office per week)

Employment Type: Full-time

About the Role:

We are seeking a highly skilled and motivated AWS Data Engineer with 5–7 years of experience in building and optimizing data pipelines, architectures, and data sets. The ideal candidate will have strong experience with AWS services including Glue, Athena, Redshift, Lambda, DMS, RDS, and CloudFormation. You will be responsible for managing the full data lifecycle from ingestion to transformation and storage, ensuring efficiency and performance.

Key Responsibilities:

  • Design, develop, and optimize scalable ETL pipelines using AWS Glue, Python/PySpark, and SQL.
  • Work extensively with AWS services such as Glue, Athena, Lambda, DMS, RDS, Redshift, CloudFormation, and other serverless technologies.
  • Implement and manage data lake and warehouse solutions using AWS Redshift and S3.
  • Optimize data models and storage for cost-efficiency and performance.
  • Write advanced SQL queries to support complex data analysis and reporting requirements.
  • Collaborate with stakeholders to understand data requirements and translate them into scalable solutions.
  • Ensure high data quality and integrity across platforms and processes.
  • Implement CI/CD pipelines and best practices for infrastructure as code using CloudFormation or similar tools.

Required Skills & Experience:

  • Strong hands-on experience with Python or PySpark for data processing.
  • Deep knowledge of AWS Glue, Athena, Lambda, Redshift, RDS, DMS, and CloudFormation.
  • Proficiency in writing complex SQL queries and optimizing them for performance.
  • Familiarity with serverless architectures and AWS best practices.
  • Experience in designing and maintaining robust data architectures and data lakes.
  • Ability to troubleshoot and resolve data pipeline issues efficiently.
  • Strong communication and stakeholder management skills.


Read more
NGO based consulting firm
NGO based consulting firm
Agency job
via Merito by Merito Talent
Delhi, Gurugram, Noida, Ghaziabad, Faridabad
25 - 35 yrs
₹25L - ₹35L / yr
skill iconHTML/CSS
skill iconjQuery
skill iconVue.js
skill iconNodeJS (Node.js)
API
+3 more

About Company:

Our client is a Delhi NCR, India headquartered 7+-year-old social/development sector-focused advisory and consulting firm. With a robust team of 100+ ICT4D professionals,they develop IT applications for NGOs, Government functionaries, CSRs, International Funding Organizations, etc. to manage theirprojects and programs in India and abroad. We are a team of young dynamic, development-conscious tech -enablers and problem solvers consisting of a diverse mix of development professionals, technology enthusiasts, software

engineers, and analysts. Our solutions enable organizations to monitor and evaluate their programs for maximum impact and operate seamlessly across everyday operations.

Job Overview:

Dhwani Rural information systems Pvt. Ltd. is looking to hire a Chief Technical Officer, to provide sound technical leadership in all aspects of the business. The CTO would be responsible for all technology systems, processes, software design and development within the company. Our ideal candidate needs to have more than 15 years of

experience building technology solutions to improve business process, increase productivity and efficiency and reduce cost for its customers, vendors, and internal employees. The candidate should have experience in social sector consulting/IT consulting/Government advisory and working with CSRs, Philanthropies or Large NGOs. The CTO must have in depth knowledge of and experience in driving technological innovation and leading product development

projects.

Responsibilities

The CTO will work with a team in the following activities -

• Lead the strategy for technology platforms, partnerships and external relationships

• Formulate a vision for how technology will be utilized within the company

• Streamline the IT Project requirements through a technological approach

• Outline company goals and timelines for research and development

• Develop technical aspects of the company’s strategy for alignment with its business goals

• Help departments use technology profitably and act as a mentor to middle management of the company

• Make executive decisions on behalf of the company’s technological requirements.

• Keep abreast of new trends and best practices in the technology landscape

• Work closely with Dhwani’s senior leadership to define and deliver new products and enhancements

Essential Tech Requirements:

• Broad knowledge of software engineering: languages, frameworks, techniques, and industry trends.

• Experience in designing and managing an effective IT governance framework across the spectrum of IT

service delivery.

• Good understanding of agile methodologies

• In-depth knowledge of web systems architecture, design and development

• Knowledge of software development life cycle. Preferable from CS/IT

• Basic understanding of how a software works (Frontend, Backend, API, Database Schema etc)

• Exposure to different off the shelf solutions (ZOHO, QuickBooks, Greythr, Google Suite, Microsoft Suite,

Zapier, Survey Monkey, IVR, SMS)

• Requirement gathering for software

• Get involved in the entire SDLC (Design, Develop, UAT, Rollout)

Essential Non-Tech Requirements:

• Accountable and ownership taking attitude

• Strong sense of purpose to work in this space (Tech4Good, ICT4D, Social Impact)

• Exceptional team management skills.

• Excellent verbal and written communication.

• Ability to multi-task and juggle various deadlines and domians

• Extensive industry knowledge with an eye towards the future.

• Prior experience of handling multiple projects in different domains at the same time

• Prior experience of managing large tech teams (50-200 engineers) including developers, designers, QAs, Das

and other teams

Qualification

Bachelor’s degree in software, computer science, engineering or any related STEM field. Have worked as a senior

engineering head or CTO in NGOs, Social Impact Consulting Firms CSR, Think Tanks, Research Organizations.

Read more
Bengaluru (Bangalore)
3 - 7 yrs
₹6L - ₹12L / yr
skill iconGo Programming (Golang)
skill iconJava
skill iconPython
skill iconRuby
skill iconRuby on Rails (ROR)
Must Have Skill

3+ years of hands-on experience in Go Lang & its design patterns
Worked in telecom domain
Good understanding of events & handler
Strong understanding & hands on experience in concurrency, go routines & channels
Strong understanding & hands on experience in Spring frameworks and their modules
Integration experience with REST or SOAP APIs
Strong hands-on experience in webservices and API

Good to have:
Docker & Kubernetes
Python development knowledge
Experience in Cloud technologies

Soft Skills:
Good communication skills & presentation skills.
Self-driven work attitude
Should be independently able to drive the tasks.
Read more
Remote only
2 - 5 yrs
₹3L - ₹8L / yr
MEAN stack
skill iconNodeJS (Node.js)
skill iconAngularJS (1.x)
skill iconExpress
skill iconMongoDB
We are looking for a Mean Stack Developer for our Australian-based organization.
 
Company Profile: 
 
WebAppMate is a prestigious software firm, committed to providing customized, technical and sophisticated software solutions for your organization. We specialize in developing IT solutions, e-commerce solutions, mobile applications, etc
 
 Experience Required:2-5 yrs
 Office Location: NSP, Delhi   
 
JD:
 
2 to 5 years of experience in Angular 6 and Above, NodeJS, Express, and MongoDB
Strong Understanding of Asynch/Multithreaded Programming
Strong understanding of HTML5, CSS3
Development and consumption of Restful APIs
Strong Understanding of Architecture Patterns and Design Patterns
Experience in TDD/BDD
Should have good DevOps working environment knowledge - Knowledge of AWS or
Azure or GCP, GIT, Ansible, Jenkins, Dockers, etc
Nice to have: Working experience in Java backend, ElasticSearch, Kafka, and API
Gateways like KONG
 
If you are interested then please send me the details mentioned below: 
Total Experience: 
Current CTC: 
Expected CTC: 
Notice Period: 
Interview Availability: 
 
 
Thanks
Pooja
Human Resources| WebAppMate
Website:-www.webappmate.com
Read more
i-Lanam Technologies
at i-Lanam Technologies
1 recruiter
Juli M
Posted by Juli M
Ahmedabad
0.6 - 2 yrs
₹1L - ₹2L / yr
skill iconHTML/CSS
skill iconJavascript

Dear Candidate,

Hope you are doing great!!

 

As per our telephonic discussion, I have attached JD.


Company Details : 
Company Name: i-Lanam Technologies

i-Lanam was established in the year 2020 with an insight to provide a

competitive approach towards application development to deliver the best quality applications at the cheapest of the prices. Looking at the need to have a company that can understand the ownership of the application output some quality developers came together to establish this company

 Canada Office

182 Central Ave, 3, London, Ontario N6A 1M7, CA


Ahmedabad Location
417 SHIVALIK SHILP Iscon Cross Road, 4th Floor, Ahmedabad,Gujarat 380015, IN

 

HTML Developer Responsibilities:

  • Meeting with Web designers to discuss project design and layout.
  • Coding the entire HTML site from end to end.
  • Debugging code and front-end web applications.
  • Ensuring cross-platform compatibility.
  • Troubleshooting application errors.
  • Conducting website performance and usability tests.
  • Meeting publication deadlines.
  • Providing user support.

HTML Developer Requirements:

  • Bachelor's degree in computer science, computer engineering, MIS, or similar.
  • At least 1 years' experience as an HTML Developer.
  • In-depth knowledge of front-end coding languages including HTML, CSS, JavaScript, and XML.
  • Ability to troubleshoot coding and application errors.
  • Knowledge of web design and user application requirements.
  • Ability to meet strict publication deadlines.
  • Excellent communication and interpersonal skills.
  • Strong attention to details
 
Read more
Big revolution in the e-gaming industry. (GK1)
Big revolution in the e-gaming industry. (GK1)
Agency job
via Multi Recruit by Ayub Pasha
Bengaluru (Bangalore)
2 - 3 yrs
₹15L - ₹20L / yr
skill iconPython
skill iconScala
Hadoop
Spark
Data Engineer
+4 more
  • We are looking for a Data Engineer to build the next-generation mobile applications for our world-class fintech product.
  • The candidate will be responsible for expanding and optimising our data and data pipeline architecture, as well as optimising data flow and collection for cross-functional teams.
  • The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimising data systems and building them from the ground up.
  • Looking for a person with a strong ability to analyse and provide valuable insights to the product and business team to solve daily business problems.
  • You should be able to work in a high-volume environment, have outstanding planning and organisational skills.

 

Qualifications for Data Engineer

 

  • Working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimising ‘big data’ data pipelines, architectures, and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Strong analytic skills related to working with unstructured datasets. Build processes supporting data transformation, data structures, metadata, dependency and workload management.
  • Experience supporting and working with cross-functional teams in a dynamic environment.
  • Looking for a candidate with 2-3 years of experience in a Data Engineer role, who is a CS graduate or has an equivalent experience.

 

What we're looking for?

 

  • Experience with big data tools: Hadoop, Spark, Kafka and other alternate tools.
  • Experience with relational SQL and NoSQL databases, including MySql/Postgres and Mongodb.
  • Experience with data pipeline and workflow management tools: Luigi, Airflow.
  • Experience with AWS cloud services: EC2, EMR, RDS, Redshift.
  • Experience with stream-processing systems: Storm, Spark-Streaming.
  • Experience with object-oriented/object function scripting languages: Python, Java, Scala.
Read more
Bizsolindia Forex Services Pvt Ltd
Pune
0 - 3 yrs
₹2L - ₹6L / yr
Business Development
Inside Sales
Sales
Job role • Understanding the company’s products intrinsically. • Data-mining along with central database to source prospective clients. • Make calls and set-up meetings to explain products/services. • Holding meetings with prospective clients and informing them about products/services offered. • Responsible for product marketing in Maharashtra. • Responsible for overall Marketing and achieving monthly/quarterly/half-yearly & annual Targets. Requirements • MBA with specialisation in Marketing/Finance • Strong inter-personal skills and comfort with English • Ability to multi-task • Comfortable with constant client interaction • Flexible attitude & Sales/Marketing mentality
Read more
Ukti Content Solutions
at Ukti Content Solutions
1 recruiter
Deepika P
Posted by Deepika P
NCR (Delhi | Gurgaon | Noida)
0 - 1 yrs
₹1L - ₹2.5L / yr
Content Writing
Technical Writing
English Proficiency
Editing
Ukti is a young company that aims to create stellar content, each day. We're looking for an editor who is passionate about communication and deeply believes in the power of words. The role demands someone proactive (getting to work instead of waiting for instructions) with killer written communication skills. Roles and Responsibilities 1. Editing content for grammar, syntax, formatting, etc. - blogs, articles, websites 2. Following and enforcing content briefs and guidelines 3. Communicating with writers and providing feedback to train them 4. Managing ongoing projects Skills and Qualifications 1. Proficient in verbal and written English 2. Comfortable working with MS Word 3. Eye for detail 4. Meticulous and sincere
Read more
Why apply to jobs via Cutshort
people_solving_puzzle
Personalized job matches
Stop wasting time. Get matched with jobs that meet your skills, aspirations and preferences.
people_verifying_people
Verified hiring teams
See actual hiring teams, find common social connections or connect with them directly.
ai_chip
Move faster with AI
We use AI to get you faster responses, recommendations and unmatched user experience.
Did not find a job you were looking for?
icon
Search for relevant jobs from 10000+ companies such as Google, Amazon & Uber actively hiring on Cutshort.
companies logo
companies logo
companies logo
companies logo
companies logo
Get to hear about interesting companies hiring right now
Company logo
Company logo
Company logo
Company logo
Company logo
Linkedin iconFollow Cutshort
Users love Cutshort
Read about what our users have to say about finding their next opportunity on Cutshort.
Shubham Vishwakarma's profile image

Shubham Vishwakarma

Full Stack Developer - Averlon
I had an amazing experience. It was a delight getting interviewed via Cutshort. The entire end to end process was amazing. I would like to mention Reshika, she was just amazing wrt guiding me through the process. Thank you team.
Companies hiring on Cutshort
companies logos