Amazon Web Services (AWS)
|
Job Title: |
Senior Cloud Service DBA |
||
|
Department & Team |
Technology |
Location: |
INDIA |
|
Reporting To: |
Senior DBA – Team Lead |
|
Role Purpose: |
|
This role will be a mix of project, BAU and innovation and will encompass typical database administration duties that you may expect in a large-scale telecommunications environment: performance tuning, replication, database design, backups, high availability, encryption, security, configuration etc.
1. Network Services Team – Responsible for IP Network and its associated components 2. Infrastructure Team – Responsible for Server and Storage systems 3. Database Services Team – Responsible for all Databases 4. Cloud Architect Team – Delivering future strategy, ongoing cloud performance optimisation.
The DBA function forms part of Client’s Tier 3 support function and works closely with the internal NOC, Service Desk, Infrastructure, IP Networks and Cloud Architect teams. To enable the business in achieving its stated objectives by assisting the other technology teams to achieve world-class benchmarks of customer service and support.
To highlight, a key requirement of the role will be involvement in defining our future strategy around database modernisation in the cloud.
|
|
Responsibilities: |
|
Operations · Involved in new solutions design discussions and to recommend suitable, secure, performance optimised database offerings based on business requirements · Ensure all databases in the AWS and Azure are configured for performance, scale and high availability where required · Take responsibility of modernisation of Clients database estate in the cloud, leveraging open source technologies and cloud native hosting platforms · Drive innovation by constantly reviewing latest public cloud platform database service releases such as Babelfish in AWS to fast track adoption of native services · Ensure security considerations are at the forefront when designing and managing database solutions · Optimise query performance · Ensure all key databases have deep insight monitoring enabled to enable improved capabilities around fault detection · Perform regular database maintenance when required and ensure databases are backed up according to agreed RTO / RPO information · Maintenance work to be planned meticulously to minimise/eradicate self-inflicted P1 outages · Monitoring database costs regularly and identify strategies to minimize cost as part of internal FinOps practices · Ability to provide technical system solutions, determine overall design direction and provide hardware recommendations for complex technical issues · Provisioning, deployment, monitoring cloud environment using automation tools like Terraform |
|
Skills & Experience: |
|
Certifications: · SQL Server Database Administration - REQUIRED · AWS Certified Solutions Architect Associate – Highly Desirable · AWS Certified Database Specialty – REQUIRED · Azure Database Administrator Associate – Highly Desirable
Skills & Experience: · Ideal candidate has been supporting traditional server based relational databases for over 8 years who then transitioned into AWS and Azure public cloud for the last 5 years · SQL Server / MSSQL 2008 / 2012 / 2014 / 2016 / 2017 / 2019 (including Always-On and Analysis Services) · Postgres / MYSQL as standalone and managed service platforms · Strong database migration experience (Particularly MSSQL to open source and leveraging AWS native platforms including RDS, Athena, Aurora) · Extensive AWS experience in a commercial environment, architecting database best practices · Strong experience supporting AWS / Azure based datalake/data warehouse environments. Required to support internal BI teams · Solid experience and understanding which workloads are best suitable for which specific database platforms in AWS and Azure · Extensive experience and understanding of database security, including appropriate encryption and authentication best practices · Good working knowledge of Microsoft Power BI · Good knowledge of Azure cloud database services · Any working experience around non-relational databases (internally hosted or managed service such as DynamoDB in AWS will be favoured) · Good working knowledge of Windows and Linux Server Operating Systems · Excellent presentation skills to both an internal and external audience · The ability to share and communicate your specific expertise to the rest of the Technology group
|
|
Behavioural Fit: |
|
· Professional appearance and manner · High personal drive; results-oriented; make things happen; “can-do attitude” · Can work and adapt within a highly dynamic and growing environment · Team Player; effective at building close working relationships with others · Effectively manages diversity within the workplace · Strong focus on service delivery and the needs and satisfaction of internal clients · Able to see issues from a global, regional and corporate perspective · Able to effectively plan and manage large projects · Excellent communication skills and interpersonal skills at all levels · Strong analytical, presentation and training skills · Innovative and creative · Visionary and strategic view of technology enablers (creative and innovative) · High verbal and written communication ability, able to influence effectively at all levels · Possesses technical expertise and knowledge to lead by example and input into technical debates · Depth and breadth of experience in infrastructure technologies · Enterprise mentality and a global mindset · Sense of humour
|
|
Role Key Performance Indicators: |
|
· Design and deliver repeatable, best in class, cloud database solutions · Pro-actively monitor service quality and take action to scale operational services, in line with business growth · Generate operating efficiencies, to be agreed with Infrastructure Services Manager · Establish a “best in sector” level of operational service delivery and insight · Help creates an effective team · Continuous improvement
|
Subodh Popalwar
Software Engineer, Memorres
Similar jobs
PythonAmazon Web Services (AWS)Required Qualifications:
∙Bachelor’s degree in computer science, Information Technology, or related field, or equivalent experience.
∙5+ years of experience in a DevOps role, preferably for a SaaS or software company.
∙Expertise in cloud computing platforms (e.g., AWS, Azure, GCP).
∙Proficiency in scripting languages (e.g., Python, Bash, Ruby).
∙Extensive experience with CI/CD tools (e.g., Jenkins, GitLab CI, Travis CI).
∙Extensive experience with NGINX and similar web servers.
∙Strong knowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes).
∙Familiarity with infrastructure-as-code tools (e.g. Terraform, CloudFormation).
∙Ability to work on-call as needed and respond to emergencies in a timely manner.
∙Experience with high transactional e-commerce platforms.
Preferred Qualifications:
∙Certifications in cloud computing or DevOps are a plus (e.g., AWS Certified DevOps Engineer,
Azure DevOps Engineer Expert).
∙Experience in a high availability, 24x7x365 environment.
∙Strong collaboration, communication, and interpersonal skills.
∙Ability to work independently and as part of a team.
C#Location: Remote
Description: Microsoft C# XAML Developer who will design and build cutting edge user
experiences for our client’s consumer facing application. The Senior Software Developer will work
closely with product owners, UX designers, front-end, and back-end developers to help build the
next generation platform.
Qualifications
• Bachelor’s degree in Computer Science, Engineering, or equivalent experience
• 5-8+ years of experience in an enterprise or consumer software development environment
• Strong knowledge of C# language and the .NET framework
• Solid understanding of object-oriented programming
• Expert level programming skills creating UWP or WPF applications using C#/XAML
• Experience with modern frameworks and design patterns, with a broader understanding of the
MVVM pattern
• Experience developing consumer facing user interfaces and supporting UI controls/components
• Ability to write clean, readable, maintainable code
• Possess excellent written and verbal communication skills
Responsibilities
• Architect, design & build modern user interface for consumers
• Collaborate with UI/UX teams to deliver high performing and easy to use applications
• Participate in code reviews with staff as necessary to ensure a high quality, performant product
• Develop a deep understanding of client goals and objectives, and articulate how your solutions
address their needs
• Unit testing/test-driven development
• Integration testing
• Deployment
• Maintenance
• Post-deployment production support and troubleshooting
Requirements
• C#, .Net Core, MVVM, Rest API, Dependency Injection.
• Azure DevOps, CI/CD, YAML setup for mobile applications preferred.
• Strong understanding of design patterns.
• Familiarity with Agile software development methodologies.
• Advanced knowledge of using Git source control system.
Education- BE, BTech , MCA , BCA and Relevant qualifications
Essential Duties and Responsibilities
Include the following, other duties that may be assigned:
Lead the Requirement Discovery Calls.
Defining the Vision
Managing & Scoping the Product Backlog
Providing solutions to solving the Assortment, Availability, Merchandizing, and Supply Chain Problems in Retail Space
Working on various metrics for Retail Industry KPIs and assessing the performance of a retail business
Work with Data Engineers on giving in-depth knowledge of the Business Requirements.
Understanding the business purpose of the story and defining and analyzing possible alternative ways of satisfying the business purpose of the story
Estimation of Level of Efforts(LOE) and Deployment Timelines.
Accountable for ensuring advanced analytics and data science outcomes are continually improved such that product and service offerings stay aligned with changing business needs and strategic objectives
Performing line management of product teams operating within an AGILE methodology
Collaborating closely with Business Owners and users to define product roadmaps, epics, features and user stories
Working with team members to take shared responsibility for the overall efforts that the team has committed to
Taking responsibility for the quality data solutions that developers produce
Interacting with Stake holders (Internal & External) as necessary to clarify requirements and agree on priorities
Review project team solution designs to ensure technical alignment & consistency against predefined target architecture and established standards
Work in partnership with third party suppliers to formulate and execute delivery of customer-focused Product & Services
Assist in developing standards for data ingestion, data access layers, application and integration of selected SaaS platforms and Data Science solutions as key components of the overall solution architecture
First Level of the Analysis of the Data Issues.
Understand End-End Flow of the application technically and functionally to enable oneself to be an eventual Product Owner.
Build and maintain architecture, design, and metadata documentation
Desired Qualifications:
Bachelor’s or Master’s in Data or Computer Science or equivalent technical field
Experience in retail industry is must
Lead the Requirement Discovery Calls.
Defining the Vision
Managing & Scoping the Product Backlog
Experience in solving business problems i.e. Assortment, Availability, Merchandizing, and Supply Chain
Providing solutions to solving the Availability, Merchandizing, and Supply Chain Problems in Retail Space
Working on various metrics for Retail Industry KPI’s and assessing the performance of a retail business
8-10 years of Overall IT Experience.
>5 years of Retail Business experience. Experience in Cloud Technologies is a plus
>2 years’ experience managing stakeholder relationships including influencing & negotiating outcomes
Experience in writing SQL and Complex SQL Queries is a Big Plus
About Us:
Prolifics Corporation Limited is a Global Technology Solutions Provider with presence across North America (USA and Canada), Europe (UK and Germany), Middle East & Asia. In India, we have off shore development centres: 3 in Hyderabad & 1 in Pune.
For more than 40 years, Prolifics has transformed enterprises of all sizes including over 100 Fortune 1000 companies by solving their complex IT challenges. Our clients include Fortune 50 and Fortune 100 companies across a broad range of industries including Financial Services, Insurance, Government, Healthcare, Telecommunications, Manufacturing and Retail. We rank consistently in Dream Companies to Work For and Dream Employer of the Year ranking from World HRD Congress, ranked 7 in 2019.
We encourage you to visit us on www.prolifics.com or follow us on Twitter, LinkedIn, Facebook, YouTube and other social media to know more about us.
Essential Duties and Responsibilities
Include the following, other duties that may be assigned:
Lead the Requirement Discovery Calls.
Defining the Vision
Managing & Scoping the Product Backlog
Providing solutions to solving the Assortment, Availability, Merchandizing, and Supply Chain Problems in Retail Space
Working on various metrics for Retail Industry KPIs and assessing the performance of a retail business
Work with Data Engineers on giving in-depth knowledge of the Business Requirements.
Understanding the business purpose of the story and defining and analyzing possible alternative ways of satisfying the business purpose of the story
Estimation of Level of Efforts(LOE) and Deployment Timelines.
Accountable for ensuring advanced analytics and data science outcomes are continually improved such that product and service offerings stay aligned with changing business needs and strategic objectives
Performing line management of product teams operating within an AGILE methodology
Collaborating closely with Business Owners and users to define product roadmaps, epics, features and user stories
Working with team members to take shared responsibility for the overall efforts that the team has committed to
Taking responsibility for the quality data solutions that developers produce
Interacting with Stake holders (Internal & External) as necessary to clarify requirements and agree on priorities
Review project team solution designs to ensure technical alignment & consistency against predefined target architecture and established standards
Work in partnership with third party suppliers to formulate and execute delivery of customer-focused Product & Services
Assist in developing standards for data ingestion, data access layers, application and integration of selected SaaS platforms and Data Science solutions as key components of the overall solution architecture
First Level of the Analysis of the Data Issues.
Understand End-End Flow of the application technically and functionally to enable oneself to be an eventual Product Owner.
Build and maintain architecture, design, and metadata documentation
Desired Qualifications:
Bachelor’s or Master’s in Data or Computer Science or equivalent technical field
Experience in retail industry is must
Lead the Requirement Discovery Calls.
Defining the Vision
Managing & Scoping the Product Backlog
Experience in solving business problems i.e. Assortment, Availability, Merchandizing, and Supply Chain
Providing solutions to solving the Availability, Merchandizing, and Supply Chain Problems in Retail Space
Working on various metrics for Retail Industry KPI’s and assessing the performance of a retail business
8-10 years of Overall IT Experience.
>5 years of Retail Business experience. Experience in Cloud Technologies is a plus
>2 years’ experience managing stakeholder relationships including influencing & negotiating outcomes
Experience in writing SQL and Complex SQL Queries is a Big Plus
About Us:
Prolifics Corporation Limited is a Global Technology Solutions Provider with presence across North America (USA and Canada), Europe (UK and Germany), Middle East & Asia. In India, we have off shore development centres: 3 in Hyderabad & 1 in Pune.
For more than 40 years, Prolifics has transformed enterprises of all sizes including over 100 Fortune 1000 companies by solving their complex IT challenges. Our clients include Fortune 50 and Fortune 100 companies across a broad range of industries including Financial Services, Insurance, Government, Healthcare, Telecommunications, Manufacturing and Retail. We rank consistently in Dream Companies to Work For and Dream Employer of the Year ranking from World HRD Congress, ranked 7 in 2019.
We encourage you to visit us on www.prolifics.com or follow us on Twitter, LinkedIn, Facebook, YouTube and other social media to know more about us.
JavaPython
Kubernetes
DockerThe Company:
It’s no surprise that 6sense is named a top workplace year after year — we have industry-leading technology developed and taken to market by a world-class team. 6sense is Top Rated on Glassdoor with a 4.9/5 and our CEO Jason Zintak was recognized as the #1 CEO in the small & medium business category by Glassdoor’s https://www.glassdoor.com/Award/Top-CEOs-at-SMBs-LST_KQ0%2C16.htm">2021 Top CEO Employees Choice Awards.
In 2021, the company was recognized for having the Best Company for Diversity, Best Company for Women, Best CEO, Best Company Culture, Best Company Perks & Benefits and Happiest Employees from the employee feedback platform Comparably. In addition, 6sense has also won several accolades that demonstrate its reputation as an employer of choice including the Glassdoor Best Place to Work (2022), TrustRadius Tech Cares (2021) and Inc. Best Workplaces (2022, 2021, 2020, 2019).
6sense reinvents the way organizations create, manage, and convert pipeline to revenue. The 6sense Revenue AI captures anonymous buying signals, predicts the right accounts to target at the ideal time, and recommends the channels and messages to boost revenue performance. Removing guesswork, friction and wasted sales effort, 6sense empowers sales, marketing, and customer success teams to significantly improve pipeline quality, accelerate sales velocity, increase conversion rates, and grow revenue predictably.
Senior Software Engineer - Infrastructure, Cloud
Responsibilities:
Develop and deploy services to improve the availability, ease of use/management, and visibility of 6sense systems
Building and scaling out our services and infrastructure
Learning and adopting technologies that may aide in solving our challenges
Own our critical underlying systems like AWS, Kubernetes, Mesos, infrastructure deployment, and compute cluster architecture (which services frameworks and engines like Hadoop/Hive/Presto)
Write/review/debug production code, develop documentation and capacity plans, and debug live production problems Contributing back to open-source projects if we need to add or patch functionality
Support the overall Software Engineering team to resolve any issues they encounter
Minimum Qualifications:
5+ years of experience with Linux/Unix system administration and networking fundamentals 3+ years in a Software Engineering role or equivalent experience
4+ years of working with AWS
4+ years of experience working with Kubernetes, Docker.
Strong skills in reading code as well as writing clean, maintainable, and scalable code
Good knowledge of Python
Experience designing, building, and maintaining scalable services and/or service-oriented architecture
Experience with high-availability
Experience with modern configuration management tools (e.g. Ansible/AWX, Chef, Puppet, Pulumi) and idempotency
Bonus Requirements:
Knowledge of standard security practices
Knowledge of the Hadoop ecosystem (e.g. Hadoop, Hive, Presto) including deployment, scaling, and maintenance Experience with operating and maintaining VPN/SSH/ZeroTrust access infrastructure
Experience with CDNs such as CloudFront and Akamai
Good knowledge of Javascript, Java, Golang
Exposure to modern build systems such as Bazel, Buck, or Pants#LI-remote
Every person in every role at 6sense owns a part of defining the future of our industry-leading technology. You’ll join a team where curiosity is prized, no one’s satisfied with the status quo, and everyone’s all-in on the collective good.6sense is a place where difference-makers roll up their sleeves, take risks, act with integrity, and measure successby the value we create for our customers.
We want 6sense to be the best chapter of your career.
Feel part of something
You’ll be part of building tomorrow’s tech, revolutionizing how marketing and sales teams create, manage, and convert pipeline to revenue. And you’ll be seen and appreciated by co-workers who challenge you, cheer you on, and always have your back.
At 6sense, you’ll experience the passion from customers and colleagues alike for our market-leading vision, and you're entrusted with applying your unique talents to help bring that vision to life.
Build a career
As part of a company on a rocketship trajectory, there’s no way around it: You’re going to experience unparalleled career growth. With colleagues as humble and hungry as you are, and a leadership philosophy grounded in trust, transparency, and empowerment, every day is a chance to improve on the one before.
Enjoy access to our Udemy Training Library with 5,000+ courses, give and get recognition from your coworkers, and spend time with our executive team every two weeks in our All Hands gathering to connect, learn and ask leaders about whatever is on your mind.
Enjoy work, and your life
This is a place where you’ll do your best work and inspire others to do theirs — where you’re guaranteed to make real connections, for life, along the way.
We want to help you prioritize health and wellness, today and tomorrow. Take advantage of family medical coverage; a monthly stipend to support your physical, mental, and financial wellness; generous paid parental leave benefits; Plus, we have an open time-off policy, so you can take the time you need.
Set for success
A vision as big as ours only comes to life when we’re all winning together.
We’ll make sure you have the equipment you need to work at home or in one of our offices. And have the right snacks, pens or lighting with our work-from-home expense reimbursement allowance. We also partner with WeWork to make sure that if your choice is a hybrid of home and office, we have you covered in the locations they’re offered.
That’s the commitment we make to every one of our employees. If this sounds like a place where you'll thrive as you take your success to the next level, let’s chat!
Spring BootAPI Lead Developer
Job Overview:
As an API developer for a very large client, you will be filling the role of a hands-on Azure API Developer. we are looking for someone who has the necessary technical expertise to build and maintain sustainable API Solutions to support identified needs and expectations from the client.
Delivery Responsibilities
- Implement an API architecture using Azure API Management, including security, API Gateway, Analytics, and API Services
- Design reusable assets, components, standards, frameworks, and processes to support and facilitate API and integration projects
- Conduct functional, regression, and load testing on API’s
- Gather requirements and defining the strategy for application integration
- Develop using the following types of Integration protocols/principles: SOAP and Web services stack, REST APIs, RESTful, RPC/RFC
- Analyze, design, and coordinate the development of major components of the APIs including hands on implementation, testing, review, build automation, and documentation
- Work with DevOps team to package release components to deploy into higher environment
Required Qualifications
- Expert Hands-on experience in the following:
- Technologies such as Spring Boot, Microservices, API Management & Gateway, Event Streaming, Cloud-Native Patterns, Observability & Performance optimizations
- Data modelling, Master and Operational Data Stores, Data ingestion & distribution patterns, ETL / ELT technologies, Relational and Non-Relational DB's, DB Optimization patterns
- At least 5+ years of experience with Azure APIM
- At least 8+ years’ experience in Azure SaaS and PaaS
- At least 8+ years’ experience in API Management including technologies such as Mulesoft and Apigee
- At least last 5 years in consulting with the latest implementation on Azure SaaS services
- At least 5+ years in MS SQL / MySQL development including data modeling, concurrency, stored procedure development and tuning
- Excellent communication skills with a demonstrated ability to engage, influence, and encourage partners and stakeholders to drive collaboration and alignment
- High degree of organization, individual initiative, results and solution oriented, and personal accountability and resiliency
- Should be a self-starter and team player, capable of working with a team of architects, co-developers, and business analysts
Preferred Qualifications:
- Ability to work as a collaborative team, mentoring and training the junior team members
- Working knowledge on building and working on/around data integration / engineering / Orchestration
- Position requires expert knowledge across multiple platforms, integration patterns, processes, data/domain models, and architectures.
- Candidates must demonstrate an understanding of the following disciplines: enterprise architecture, business architecture, information architecture, application architecture, and integration architecture.
- Ability to focus on business solutions and understand how to achieve them according to the given timeframes and resources.
- Recognized as an expert/thought leader. Anticipates and solves highly complex problems with a broad impact on a business area.
- Experience with Agile Methodology / Scaled Agile Framework (SAFe).
- Outstanding oral and written communication skills including formal presentations for all levels of management combined with strong collaboration/influencing.
Preferred Education/Skills:
- Prefer Master’s degree
- Bachelor’s Degree in Computer Science with a minimum of 12+ years relevant experience or equivalent.
Python
React.jsA network of the world's best developers - full-time, long-term remote software jobs with better compensation and career growth. We enable our clients to accelerate their Cloud Offering, and Capitalize on Cloud. We have our own IOT/AI platform and we provide professional services on that platform to build custom clouds for their IOT devices. We also build mobile apps, run 24x7 devops/site reliability engineering for our clients.
You will be working on AI/IOT cloud and responsible for architecture and ensuring the aspects such as fault tolerance and scalability. You will lead the troubleshooting of the cloud. We need someone who can engage in conversations about detailed technical architecture with an internal team and external customers. You will be responsible for creating architecture documents, explaining design, troubleshooting, reviewing work by others in the team, giving good guidance, and ensuring functional cloud. We are looking for a can do it attitude, and ability to deliver with high velocity and high-quality at the same time.
We use MQTT, RabbitMQ, Cassandra, MongDB, CloudFlare and backend components to build APIs. You will be working on our IOT/AI cloud platform and building/architecting/coding as well as leading other technical engineers in a team.
The primary programming language should be Python or ReactJS or NodeJS and one of them as secondary.
This person MUST have:
- BE Computer Science, MCA or equivalent
- Cloud app development experience
- Strong Troubleshooting/Debugging experience
- Expert in RabbitMQ internals
- Experience with SQL and NOSQL databases
- Strong communication skills
- experience with software build and devops
- strong in programming
- experience with Cassandra
This person’s RESPONSIBILITY will be to:
- understand full arch
- understand every workflow and logs
- can fix bugs by his hands
- able to troubleshoot in cloud
- able to fix and deploy
- able to see database contents
Experience:
- Min 5 year experience
- Not more than 15 year experience.
- Startup experience is a must.
Location
- Remotely, anywhere in India
Timings:
- 40 hours a week but with 4 hours a day overlapping with client timezone. Typically clients are in California PST Timezone.
Position:
- Full time/Direct
- We have great benefits such as PF, medical insurance, 12 annual company holidays, 12 PTO leaves per year, annual increments, Diwali bonus, spot bonuses and other incentives etc.
- We dont believe in locking in people with large notice periods. You will stay here because you love the company. We have only a 15 days notice period.
Responsibilities :
- Provide Support Services to our Gold & Enterprise customers using our flagship product suits. This may include assistance provided during the engineering and operations of distributed systems as well as responses for mission-critical systems and production customers.
- Lead end-to-end delivery and customer success of next-generation features related to scalability, reliability, robustness, usability, security, and performance of the product
- Lead and mentor others about concurrency, parallelization to deliver scalability, performance, and resource optimization in a multithreaded and distributed environment
- Demonstrate the ability to actively listen to customers and show empathy to the customer’s business impact when they experience issues with our products
Requires Skills :
- 10+ years of Experience with a highly scalable, distributed, multi-node environment (100+ nodes)
- Hadoop operation including Zookeeper, HDFS, YARN, Hive, and related components like the Hive metastore, Cloudera Manager/Ambari, etc
- Authentication and security configuration and tuning (KNOX, LDAP, Kerberos, SSL/TLS, second priority: SSO/OAuth/OIDC, Ranger/Sentry)
- Java troubleshooting, e.g., collection and evaluation of jstacks, heap dumps
- Linux, NFS, Windows, including application installation, scripting, basic command line
- Docker and Kubernetes configuration and troubleshooting, including Helm charts, storage options, logging, and basic kubectl CLI
- Experience working with scripting languages (Bash, PowerShell, Python)
- Working knowledge of application, server, and network security management concepts
- Familiarity with virtual machine technologies
- Knowledge of databases like MySQL and PostgreSQL,
- Certification on any of the leading Cloud providers (AWS, Azure, GCP ) and/or Kubernetes is a big plus
Job title: Azure Architect
Locations: Noida, Pune, Bangalore and Mumbai
Responsibilities:
- Develop and maintain scalable architecture, database design and data pipelines and build out new Data Source integrations to support continuing increases in data volume and complexity
- Design and Develop the Data lake, Data warehouse using Azure Cloud Services
- Assist in designing end to end data and Analytics solution architecture and perform POCs within Azure
- Drive the design, sizing, POC setup, etc. of Azure environments and related services for the use cases and the solutions
- Reviews the solution requirements support architecture design to ensure the selection of appropriate technology, efficient use of resources and integration of multiple systems and technology.
- Must possess good client-facing experience with the ability to facilitate requirements sessions and lead teams
- Support internal presentations to technical and business teams
- Provide technical guidance, mentoring and code review, design level technical best practices
Experience Needed:
- 12-15 years of industry experience and at least 3 years of experience in architect role is required along with at least 3 to 4 years’ experience designing and building analytics solutions in Azure.
- Experience in architecting data ingestion/integration frameworks capable of processing structured, semi-structured & unstructured data sets in batch & real-time
- Hands-on experience in the design of reporting schemas, data marts and development of reporting solutions
- Develop batch processing, streaming and integration solutions and process Structured and Non-Structured Data
- Demonstrated experience with ETL development both on-premises and in the cloud using SSIS, Data Factory, and Azure Analysis Services and other ETL technologies.
- Experience in Perform Design, Development & Deployment using Azure Services ( Azure Synapse, Data Factory, Azure Data Lake Storage, Databricks, Python and SSIS)
- Worked with transactional, temporal, time series, and structured and unstructured data.
- Deep understanding of the operational dependencies of applications, networks, systems, security, and policy (both on-premise and in the cloud; VMs, Networking, VPN (Express Route), Active Directory, Storage (Blob, etc.), Windows/Linux).
Mandatory Skills: Azure Synapse, Data Factory, Azure Data Lake Storage, Azure DW, Databricks, Python
ScalaAmazon Web Services (AWS)Your mission is to help lead team towards creating solutions that improve the way our business is run. Your knowledge of design, development, coding, testing and application programming will help your team raise their game, meeting your standards, as well as satisfying both business and functional requirements. Your expertise in various technology domains will be counted on to set strategic direction and solve complex and mission critical problems, internally and externally. Your quest to embracing leading-edge technologies and methodologies inspires your team to follow suit.
Responsibilities and Duties :
- As a Data Engineer you will be responsible for the development of data pipelines for numerous applications handling all kinds of data like structured, semi-structured &
unstructured. Having big data knowledge specially in Spark & Hive is highly preferred.
- Work in team and provide proactive technical oversight, advice development teams fostering re-use, design for scale, stability, and operational efficiency of data/analytical solutions
Education level :
- Bachelor's degree in Computer Science or equivalent
Experience :
- Minimum 3+ years relevant experience working on production grade projects experience in hands on, end to end software development
- Expertise in application, data and infrastructure architecture disciplines
- Expert designing data integrations using ETL and other data integration patterns
- Advanced knowledge of architecture, design and business processes
Proficiency in :
- Modern programming languages like Java, Python, Scala
- Big Data technologies Hadoop, Spark, HIVE, Kafka
- Writing decently optimized SQL queries
- Orchestration and deployment tools like Airflow & Jenkins for CI/CD (Optional)
- Responsible for design and development of integration solutions with Hadoop/HDFS, Real-Time Systems, Data Warehouses, and Analytics solutions
- Knowledge of system development lifecycle methodologies, such as waterfall and AGILE.
- An understanding of data architecture and modeling practices and concepts including entity-relationship diagrams, normalization, abstraction, denormalization, dimensional
modeling, and Meta data modeling practices.
- Experience generating physical data models and the associated DDL from logical data models.
- Experience developing data models for operational, transactional, and operational reporting, including the development of or interfacing with data analysis, data mapping,
and data rationalization artifacts.
- Experience enforcing data modeling standards and procedures.
- Knowledge of web technologies, application programming languages, OLTP/OLAP technologies, data strategy disciplines, relational databases, data warehouse development and Big Data solutions.
- Ability to work collaboratively in teams and develop meaningful relationships to achieve common goals
Skills :
Must Know :
- Core big-data concepts
- Spark - PySpark/Scala
- Data integration tool like Pentaho, Nifi, SSIS, etc (at least 1)
- Handling of various file formats
- Cloud platform - AWS/Azure/GCP
- Orchestration tool - Airflow
Follow CutshortSubodh Popalwar
Software Engineer, Memorres