Data Engineer
Brief Posting Description:
This person will work independently or with a team of data engineers on cloud technology products, projects, and initiatives. Work with all customers, both internal and external, to make sure all data related features are implemented in each solution. Will collaborate with business partners and other technical teams across the organization as required to deliver proposed solutions.
Detailed Description:
· Works with Scrum masters, product owners, and others to identify new features for digital products.
· Works with IT leadership and business partners to design features for the cloud data platform.
· Troubleshoots production issues of all levels and severities, and tracks progress from identification through resolution.
· Maintains culture of open communication, collaboration, mutual respect and productive behaviors; participates in the hiring, training, and retention of top tier talent and mentors team members to new and fulfilling career experiences.
· Identifies risks, barriers, efficiencies and opportunities when thinking through development approach; presents possible platform-wide architectural solutions based on facts, data, and best practices.
· Explores all technical options when considering solution, including homegrown coding, third-party sub-systems, enterprise platforms, and existing technology components.
· Actively participates in collaborative effort through all phases of software development life cycle (SDLC), including requirements analysis, technical design, coding, testing, release, and customer technical support.
· Develops technical documentation, such as system context diagrams, design documents, release procedures, and other pertinent artifacts.
· Understands lifecycle of various technology sub-systems that comprise the enterprise data platform (i.e., version, release, roadmap), including current capabilities, compatibilities, limitations, and dependencies; understands and advises of optimal upgrade paths.
· Establishes relationships with key IT, QA, and other corporate partners, and regularly communicates and collaborates accordingly while working on cross-functional projects or production issues.
Job Requirements:
EXPERIENCE:
2 years required; 3 - 5 years preferred experience in a data engineering role.
2 years required, 3 - 5 years preferred experience in Azure data services (Data Factory, Databricks, ADLS, Synapse, SQL DB, etc.)
EDUCATION:
Bachelor’s degree information technology, computer science, or data related field preferred
SKILLS/REQUIREMENTS:
Expertise working with databases and SQL.
Strong working knowledge of Azure Data Factory and Databricks
Strong working knowledge of code management and continuous integrations systems (Azure DevOps or Github preferred)
Strong working knowledge of cloud relational databases (Azure Synapse and Azure SQL preferred)
Familiarity with Agile delivery methodologies
Familiarity with NoSQL databases (such as CosmosDB) preferred.
Any experience with Python, DAX, Azure Logic Apps, Azure Functions, IoT technologies, PowerBI, Power Apps, SSIS, Informatica, Teradata, Oracle DB, and Snowflake preferred but not required.
Ability to multi-task and reprioritize in a dynamic environment.
Outstanding written and verbal communication skills
Working Environment:
General Office – Work is generally performed within an office environment, with standard office equipment. Lighting and temperature are adequate and there are no hazardous or unpleasant conditions caused by noise, dust, etc.
physical requirements:
Work is generally sedentary in nature but may require standing and walking for up to 10% of the time.
Mental requirements:
Employee required to organize and coordinate schedules.
Employee required to analyze and interpret complex data.
Employee required to problem-solve.
Employee required to communicate with the public.
Shubham Vishwakarma
Full Stack Developer - Averlon
About Gipfel & Schnell Consultings Pvt Ltd
About
Gipfel & Schnell was born from a seed of thought, to provide exceptional service(s) to the ever-expanding conglomerate of businesses across the Knowledge Space. We have over time, amassed a wide array of success stories based on our ability to function as a Value driven extension with all of our Partners. This has been forged in the areas of Talent Acquisition, HR Practice, BPR and IT Consulting.
G&S with its rich and diverse team boasting of extensive experience across Industries, Functions and Geographic Locations strongly believe in All-Round Solutions to give its Partners a competitive edge in the respective areas.
Company social profiles
Similar jobs
We are seeking an experienced Web Scraping Engineer to data extraction efforts for our enterprise clients. In this role, you will be tasked with creating and maintaining robust, large-scale scraping systems for gathering structured data.
Responsibilities:
Develop and optimize custom web scraping tools and workflows.
Integrate scraping systems with data storage solutions like SQL and NoSQL databases.
Troubleshoot and resolve scraping challenges, including CAPTCHAs, rate limiting, and IP blocking.
Provide technical guidance on scraping best practices and standards.
Skills Required:
Expert in Python and scraping libraries such as Scrapy and BeautifulSoup.
Deep understanding of web scraping techniques and challenges (CAPTCHAs, anti-bot measures).
Experience with cloud platforms (AWS, Google Cloud).
Strong background in databases and data storage systems (SQL, MongoDB).
React.js
NodeJS (Node.js)
MongoDB- Frontend: Proficiency in React.js, Redux/Context API, JavaScript (ES6+), HTML5, CSS3.
- Backend: Strong knowledge of Node.js, Express.js, and REST API development.
- Databases: Hands-on experience with PostgreSQL, SQL (MySQL/SQL Server), and MongoDB.
- Experience in query optimization, stored procedures, and database design.
- Strong understanding of authentication, authorization (JWT, OAuth2), and security best practices.
- Proficient with Git and collaborative tools (GitHub/GitLab/Bitbucket).
NodeJS (Node.js)
JavascriptMongoDB
ExpressUrgently Hiring Node.js Backend Developer for our IT company Logical Softtech, Indore(M.P)
Job Location : Indore ( work from Office)
Experience needed : minimum 6 months needed
******
1) Node.js Backend Developer must have expertise in developing database with mongo db, backend, admin panel , web services, rest api, crude operation.
2) Must have expertise in cloud hosting, maintaining all server-side network components, command prompt.
3) Extensive knowledge of JavaScript, web stacks, libraries, and frameworks.
4) Can work individually or in a team , immediate joiner
5) Any other MERN / MEAN /PHP framework knowledge will be added plus
*****
NodeJS (Node.js)MongoDBJob Title: Backend Developer
Experience: 2+ Years
Location: Bangalore, India
Elocity is a cleantech start-up striving to make the world a better place through technology innovations. We are building a global infrastructure for making the transition to electric vehicles viable, affordable, and
sustainable by working closely with the utilities, governments, and public.
Headquartered out of Canada, we are a team of highly specialized domain experts and problem solvers enabling utilities, public and private sector entities to successfully manage the demands of electric vehicle charging and its infrastructure needs to pave the way for electromobility in future.
To know more visit https://elocitytech.com/
Responsibilities:
• Determines technical feasibility of features or solutions by evaluating problem, customer
requirements, possible solutions and technology requirements.
• Exercises judgement in prioritizing tasks and selecting methods and techniques for obtaining solutions.
• Create low-level design of modules of a software application through proper documentation and
diagrams.
• Develops software solutions by studying requirements, clarifying customer/user needs, analysing data
and processes and following established software development practices and processes.
• Develops proof of concepts for technical evaluation and early customer feedback
• Updates and shares knowledge by studying state-of-the-art development tools, programming
techniques, and computing technology; reading professional publications
• Networks with internal and external personnel in own area of expertise.
Skills:
• Good command in JavaScript/TypeScript. Knowledge of Java/Python will be a plus.
• Experience in Debugging/troubleshooting TypeScript code.
• Experience in API development (REST/GraphQL etc)
• Experience in development of Web and Mobile(android/iOS) applications
• Exposure of Parallel and Asynchronous programming
• Experience in writing Unit tests (Jest or any similar framework)
• Should be proficient in relational Database concepts (Postgres etc.)
• Knowledge of Non-relational Databases would be a plus.
• Good Understanding of Object-Oriented Programming Concepts.
• Good Understanding of Design Patterns.
• Good command of Data structures, Algorithms and Complexity.
• Good at problem solving and analytical skills.
• Experience with Source Code Versioning systems (Git etc)
• Understanding of Micro services Architecture would be a plus
Responsibilities:
Providing software application support under the supervision of the Senior Engineer.
Performing analyses on software application functionality and suggesting improvements.
Ensuring effective front-end and back-end functionality of applications.
Consulting with the software development team, internal users, and clients to improve application performance.
Establishing the root causes of application errors, and escalating serious concerns to the Senior Engineer.
Keeping a record of configuration changes and scheduling application updates.
Documenting processes and monitoring application performance metrics.
Providing front-end support to clients and colleagues in other departments.
Requirements:
A bachelor's degree in software engineering, computer science, information technology, information systems, computer engineering, or similar.
Demonstrable experience as an application support engineer in a related field.
Advanced knowledge of integration and system testing
Ability to manage code migration, document configuration changes, and monitor performance.
Exceptional ability to provide front-end support to internal departments and web-based clients.
Advanced proficiency in determining the causes of application errors and repairing them.
- Technical skills:
- Primary skills :
- Siebel CSW
Should have hands on experience Siebel Configuration, Scripting and Workflows
- Siebel Integration
Should have hands on experience Siebel integrations like JMS\MQ, Web services, VBC, EBC, Rest Service, API building etc.
- Siebel OpenUI
Should have hands on experience in Siebel OpenUI development.
- Database (SQL /Oracle)
Should have good experience in writing queries, performance management, query optimization etc.
- Should be able to work independently and should have strong debugging skills
- Secondary skills : (Good to have)
- Siebel certification
- Exposure to Agile
- Exposure to HP ALM and JIRA
- Candidate’s overall experience should be min 5 years to max 8 years.
Java- Looking only for immediate to 15 days candidate.
- Looking for an experienced Integration specialist with a good expertise in ETL Informatica and a strong Application integration background
- Minimum of 3+ years relevant experience in Informatica MDM required. Powercenter is a core skill set.
- Having experience in a broader Informatica toolset is strongly preferred
- Should prove a very strong implementation experience in Application integration, should demonstrate expertise/presentation with multiple use cases
- Passionate coders with a strong Application development background, years of experience could range from 5+ to 15+
- Should have application development experience outside of ETL, (just learning ETL as a tool is not enough), experience in writing application outside of ETL will bring in more value
- Strong database skills with a strong understanding of data, data quality, data governance, understanding and developing standalone and integrated database layers (sql, packages, functions, performance tuning ), i.e. Expert with a strong integration background who has more application integration background than just an ETL Informatica tool
- Experience in integration with XML/JSON based and heavily involve JMS MQ (read/write)
- Experience in SOAP and REST based API's exchanging both XML and JSON files used for request and response
- Experience with Salesforce.com Integration using Informatica power exchange module is a plus but not needed
- Experience with Informatica MDM as a technology stack that is used for integration of senior market members with Salesforce.com is a plus but not needed,
- Very strong scripting background (C/bourne shell/Perl/Java)
- Should be able to understand JAVA, we do have development around JAVA, i.e ability to work around a solution in programming language like Java when implementation is not possible through ETL
- Ability to communicate effectively via multiple channels (verbal, written, etc.) with technical and non-technical staff.
Data Science
Deep Learning
C#
Follow CutshortShubham Vishwakarma
Full Stack Developer - Averlon