Position: Lead Software Engineer
Job Overview:
Lead ETL Engineer with SSIS (SQL Server Integration Services) knowledge is primarily responsible for designing, developing, and maintaining ETL (Extract, Transform, Load) workflows and data integration processes to support enterprise data solutions.
Key Responsibilities and Duties
Lead the software development team:
- Lead a team of software engineers in designing, developing, and maintaining ETL Framework.
- Set and communicate clear expectations for the clients regarding project timelines, quality standards, and deliverables.
- Experience with Microsoft SQL Server Database,
- Hands-on experience in writing, optimizing and maintaining complex SQL queries, stored procedures and functions.
- Design and develop robust, scalable, and efficient database structures based on the organization's requirements.
SSIS:
- Design, develop, test, deploy, and maintain SSIS packages for data migration, ETL processes, reporting and to integrate data between various systems.
- Develop complex SQL queries to extract data from various sources such as Oracle or SQL databases.
- Troubleshoot issues related to package execution failures and optimize performance of existing packages.
- Collaborate with stakeholders to understand business requirements and design solutions using SQL Server Integration Services (SSIS).
- Work closely with the team to ensure timely delivery of projects.
- Optimize existing integrations for improved performance and scalability.
- Design and implement complex SSIS packages for extracting, transforming, and loading data from various sources such as relational databases (SQL Server, Oracle, DB2), flat files, and XML files.
- Develop ETL best practices, including error handling, logging, checkpoints, and data quality assurance.
- Write efficient SQL queries, stored procedures, functions, and triggers to support ETL processes.
- Optimize SSIS packages and SQL queries for maximum performance using techniques such as parallelization, lookup caching, and bulk loading.
- Create and maintain design documentation such as data models, mapping documents, data flow diagrams, and architecture diagrams.
- Collaborate with business analysts, BI teams, and other stakeholders to understand requirements and deliver data solutions for reporting and analytics.
- Schedule and monitor SSIS workflows using SQL Server Agent or other scheduling tools, ensuring timely and error-free data loads.
- Troubleshoot, debug, and test SSIS packages and backend database processes to ensure data accuracy and system reliability.
- Participate in resource planning, task estimation, and code review processes.
Collaborate with cross-functional teams:
- Work with other teams such as product management, quality assurance, and user experience to ensure that software applications meet business requirements and user needs.
- Communicate effectively with team members and stakeholders.
Stay up to date with emerging trends and technologies:
- Keep up to date with emerging trends and technologies in the software development industry.
- Make recommendations for improvements to existing software applications and processes.
Mandatory skills
SSIS, understanding of ETL Framework, able to design and implement SSIS
Qualifications
- Bachelor’s degree in computer science or related field.
- 6-9 years of experience in software development.
- Proven leadership experience in leading ETL teams.
- Knowledge of software development methodologies such as Agile or Scrum.
- Ability to mentor and train junior team members.
Shubham Vishwakarma
Full Stack Developer - Averlon
About Opteamix
About
Company social profiles
Similar jobs
Python
FlaskWe are looking for a Technical Lead - GenAI with a strong foundation in Python, Data Analytics, Data Science or Data Engineering, system design, and practical experience in building and deploying Agentic Generative AI systems. The ideal candidate is passionate about solving complex problems using LLMs, understands the architecture of modern AI agent frameworks like LangChain/LangGraph, and can deliver scalable, cloud-native back-end services with a GenAI focus.
Key Responsibilities :
- Design and implement robust, scalable back-end systems for GenAI agent-based platforms.
- Work closely with AI researchers and front-end teams to integrate LLMs and agentic workflows into production services.
- Develop and maintain services using Python (FastAPI/Django/Flask), with best practices in modularity and performance.
- Leverage and extend frameworks like LangChain, LangGraph, and similar to orchestrate tool-augmented AI agents.
- Design and deploy systems in Azure Cloud, including usage of serverless functions, Kubernetes, and scalable data services.
- Build and maintain event-driven / streaming architectures using Kafka, Event Hubs, or other messaging frameworks.
- Implement inter-service communication using gRPC and REST.
- Contribute to architectural discussions, especially around distributed systems, data flow, and fault tolerance.
Required Skills & Qualifications :
- Strong hands-on back-end development experience in Python along with Data Analytics or Data Science.
- Strong track record on platforms like LeetCode or in real-world algorithmic/system problem-solving.
- Deep knowledge of at least one Python web framework (e.g., FastAPI, Flask, Django).
- Solid understanding of LangChain, LangGraph, or equivalent LLM agent orchestration tools.
- 2+ years of hands-on experience in Generative AI systems and LLM-based platforms.
- Proven experience with system architecture, distributed systems, and microservices.
- Strong familiarity with Any Cloud infrastructure and deployment practices.
- Should know about any Data Engineering or Analytics expertise (Preferred) e.g. Azure Data Factory, Snowflake, Databricks, ETL tools Talend, Informatica or Power BI, Tableau, Data modelling, Datawarehouse development.
Amazon Web Services (AWS)Responsibilities include:
- Develop and maintain data validation logic in our proprietary Control Framework tool
- Actively participate in business requirement elaboration and functional design sessions to develop an understanding of our Operational teams’ analytical needs, key data flows and sources
- Assist Operational teams in the buildout of Checklists and event monitoring workflows within our Enterprise Control Framework platform
- Build effective working relationships with Operational users, Reporting and IT development teams and business partners across the organization
- Conduct interviews, generate user stories, develop scenarios and workflow analyses
- Contribute to the definition of reporting solutions that empower Operational teams to make immediate decisions as to the best course of action
- Perform some business user acceptance testing
- Provide production support and troubleshooting for existing operational dashboards
- Conduct regular demos and training of new features for the stakeholder community
Qualifications
- Bachelor’s degree or equivalent in Business, Accounting, Finance, MIS, Information Technology or related field of study
- Minimum 5 years’ of SQL required
- Experience querying data on cloud platforms (AWS/ Azure/ Snowflake) required
- Exceptional problem solving and analytical skills, attention to detail and organization
- Able to independently troubleshoot and gather supporting evidence
- Prior experience developing within a BI reporting tool (e.g. Spotfire, Tableau, Looker, Information Builders) a plus
- Database Management and ETL development experience a plus
- Self-motivated, self-assured, and self-managed
- Able to multi-task to meet time-driven goals
- Asset management experience, including investment operation a plus
- Bachelor's degree required, or higher education level, or foreign equivalent, preferably in area wit
- At least 5 years experience in Duck Creek Data Insights as Technical Architect/Senior Developer.
- Strong Technical knowledge on SQL databases, MSBI.
- Should have strong hands-on knowledge on Duck Creek Insight product, SQL Server/DB level configuration, T-SQL, XSL/XSLT, MSBI etc
- Well versed with Duck Creek Extract Mapper Architecture
- Strong understanding of Data Modelling, Data Warehousing, Data Marts, Business Intelligence with ability to solve business problems
- Strong understanding of ETL and EDW toolsets on the Duck Creek Data Insights
- Strong knowledge on Duck Creek Insight product overall architecture flow, Data hub, Extract mapper etc
- Understanding of data related to business application areas policy, billing, and claims business solutions
- Minimum 4 to 7 year working experience on Duck Creek Insights product
- Strong Technical knowledge on SQL databases, MSBI
- Preferable having experience in Insurance domain
- Preferable experience in Duck Creek Data Insights
- Experience specific to Duck Creek would be an added advantage
- Strong knowledge of database structure systems and data mining
- Excellent organisational and analytical abilities
- Outstanding problem solver
MongoDBRequiredSkills:
• Minimum of 4-6 years of experience in data modeling (including conceptual, logical and physical data models. • 2-3 years of experience inExtraction, Transformation and Loading ETLwork using data migration tools like Talend, Informatica, Datastage, etc. • 4-6 years of experience as a database developerinOracle, MS SQLor another enterprise database with a focus on building data integration process • Candidate should haveanyNoSqltechnology exposure preferably MongoDB. • Experience in processing large data volumes indicated by experience with BigDataplatforms (Teradata, Netezza, Vertica or Cloudera, Hortonworks, SAP HANA, Cassandra, etc.). • Understanding of data warehousing concepts and decision support systems.
• Ability to deal with sensitive and confidential material and adhere to worldwide data security and • Experience writing documentation for design and feature requirements. • Experience developing data-intensive applications on cloud-based architectures and infrastructures such as AWS, Azure etc. • Excellent communication and collaboration skills.
Bangalore
Immediate
- Design, build and deploy effective SSIS packages to validate, synthesize, transform customer data for integrated business planning and analytics
- Understand platform’s data model (table structures, linkages, optimal designs) for designing various planning use cases
- Review and analyse the data provided by customers along with its technical/functional intent and interdependencies
- Participate in the technical design, data requirements gathering and making recommendations on best practices, in case of inaccurate or missing data
- Design and automate the data loading and insights generation process with intelligent checks and balances for sustained value delivery
- Create and execute test plans,document issues and track progress at resolving issues.
Amazon Web Services (AWS)Criteria:
- BE/MTech/MCA/MSc
- 3+yrs Hands on Experience in TSQL / PL SQL / PG SQL or NOSQL
- Immediate joiners preferred*
- Candidates will be selected based on logical/technical and scenario-based testing
Note: Candidates who have attended the interview process with TnS in the last 6 months will not be eligible.
Job Description:
- Technical Skills Desired:
- Experience in MS SQL Server and one of these Relational DB’s, PostgreSQL / AWS Aurora DB / MySQL / Oracle / NOSQL DBs (MongoDB / DynamoDB / DocumentDB) in an application development environment and eagerness to switch
- Design database tables, views, indexes
- Write functions and procedures for Middle Tier Development Team
- Work with any front-end developers in completing the database modules end to end (hands-on experience in parsing of JSON & XML in Stored Procedures would be an added advantage).
- Query Optimization for performance improvement
- Design & develop SSIS Packages or any other Transformation tools for ETL
- Functional Skills Desired:
- Banking / Insurance / Retail domain would be a
- Interaction with a client a
3. Good to Have Skills:
- Knowledge in a Cloud Platform (AWS / Azure)
- Knowledge on version control system (SVN / Git)
- Exposure to Quality and Process Management
- Knowledge in Agile Methodology
- Soft skills: (additional)
- Team building (attitude to train, work along, mentor juniors)
- Communication skills (all kinds)
- Quality consciousness
- Analytical acumen to all business requirements
Think out-of-box for business solution
Java
Spring Boot• Exposure to latest Technology
• Opportunity working in different platforms
• Rapid Career Growth
• Friendly Knowledge sharing Environment
Criteria:
• BE/MTech/MCA/MSc
• 3+yrs Hands on Experience in TSQL / PL SQL / PG SQL or NOSQL
• Immediate joiners preferred/ Maximum notice period between 15 to 30days
• Candidates will be selected based on logical / technical and scenario-based testing
Note: Candidates who have attended the interview process with TnS in the last 6 months will not be
eligible.
Job Description:
Technical Skills Desired:
- Experience in either of these Relational DB’s MS SQL Server / PostgreSQL / AWS Aurora DB / MySQL / Oracle / NOSQL DBs (MongoDB / DynamoDB / DocumentDB) in an application development environment and eagerness to switch DB.
- Design database tables, views, indexes
- Write functions and procedures for Middle Tier Development Team
- Work with any front-end developers in completing the database modules end to end (hands-on experience in parsing of JSON & XML in Stored Procedures would be an added advantage).
- Query Optimization for performance improvement
- Design & develop SSIS Packages or any other Transformation tools for ETL
Functional Skills Desired:
- Banking / Insurance / Retail domain would be a plus.
- Interaction with a client a plus
Good to Have Skills:
- Knowledge in a Cloud Platform (AWS / Azure)
- Knowledge on version control system (SVN / Git)
- Exposure to Quality and Process Management
- Knowledge in Agile Methodology
Soft skills: (additional)
- Team building (attitude to train, work along, mentor juniors)
- Communication skills (all kinds)
- Quality consciousness
- Analytical acumen to all business requirement
- Think out-of-box for business solution
PythonAmazon Web Services (AWS)
Elastic SearchAbout SteelEye
SteelEye is a fast growing FinTech company based in London and has offices in Bangalore and Paris, that offers a data platform to help financial institutions such as Investment Banks, Hedge Funds, Brokerage Firms, Asset Management Firms to comply with financial regulations in the European Union. Our clients can aggregate, search, surveillance and report on trade, communications and market data. SteelEye also enables customers to gain powerful insights from their data, helping them to trade with greater efficiency and profitability. The company has a highly experienced management team and a strong board, who have decades of technology and management experience and worked in senior positions at many leading international financial businesses. We are looking to hire a seasoned SRE to join us as we start on our next phase of growth. We have a culture of openness, collaboration, and the passion to get things done whilst appreciating the importance of a good work life balance.
Being part of a start-up can be equally exciting as it is challenging. You will be part of the SteelEye team not just because of your talent but also because of your entrepreneurial flare which we thrive on at SteelEye. This means we want you to be curious, contribute, ask questions and share ideas. We encourage you to get involved in helping shape our business.
What you’ll do
- Deliver plugins for our Python-based ETL pipelines.
- Deliver Python microservices for provisioning and managing cloud infrastructure.
- Implement algorithms to analyse large data sets.
- Draft design documents that translate requirements into code.
- Deal with challenges associated with handling large volumes of data.
- Assume responsibilities from technical design through technical client support.
- Manage expectations with internal stakeholders and context-switch in a fast paced environment.
- Thrive in an environment that uses AWS and Elasticsearch extensively.
- Keep abreast of technology and contribute to the engineering strategy.
- Champion best development practices and provide mentorship.
What we’re looking for
- Experience in o Python 3.
- o Python libraries used for data (such as pandas, numpy).
- o AWS.
- o Elasticsearch.
- o Performance tuning.
- o Object Oriented Design and Modelling.
- o Delivering complex software, ideally in a FinTech setting.
- o CI/CD tools.
- Knowledge of design patterns.
- Sharp analytical and problem-solving skills.
- Strong sense of ownership.
- Demonstrable desire to learn and grow.
- Excellent written and oral communication skills.
- Mature collaboration and mentoring abilities.
About SteelEye Culture
- Work from home until you are vaccinated against COVID-19
- Top of the line health insurance • Order discounted meals every day from a dedicated portal
- Fair and simple salary structure
- 30+ holidays in a year
- Fresh fruits every day
- Centrally located. 5 mins to the nearest metro station (MG Road)
- Measured on output and not input
Week off: Friday & Saurday
Day Shift.
Key responsibilities:
- Creating, designing and developing data models
- Prepare plans for all ETL (Extract/Transformation/Load) procedures and architectures
- Validating results and creating business reports
- Monitoring and tuning data loads and queries
- Develop and prepare a schedule for a new data warehouse
- Analyze large databases and recommend appropriate optimization for the same
- Administer all requirements and design various functional specifications for data
- Provide support to the Software Development Life cycle
- Prepare various code designs and ensure efficient implementation of the same
- Evaluate all codes and ensure the quality of all project deliverables
- Monitor data warehouse work and provide subject matter expertise
- Hands-on BI practices, data structures, data modeling, SQL skills
Hard Skills for a Data Warehouse Developer:
- Hands-on experience with ETL tools e.g., DataStage, Informatica, Pentaho, Talend
- Sound knowledge of https://www.freelancermap.com/it-projects/sql-1084" target="_blank">SQL
- Experience with SQL databases such as Oracle, DB2, and SQL
- Experience using Data Warehouse platforms e.g., SAP, Birst
- Experience designing, developing, and implementing Data Warehouse solutions
- Project management and system development methodology
- Ability to proactively research solutions and best practices
Soft Skills for Data Warehouse Developers:
- Excellent Analytical skills
- Excellent verbal and written communications
- Strong organization skills
- Ability to work on a team, as well as independently
.NET
Javascript
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon