QA Test Engineer & Performance Manager | Dynatrace Specialist
+10 years of experience in sftw. testing & performance analysis. QA evangelist
Responsiveness
A service that aims to achieve the “peak performance” of a given software application.
By employing techniques and focusing on the activities of:
Monitoring and observability
Testing
Analysis and team adoption
to embracing software quality assurance
0%
Up to
A combination of studies show that poor user experience will directly impact businesses’ conversion rate from 1% up to 11%.
Beside customer’s dissatisfaction and other negative factors
According to various source/references
A service that aims to achieve the “peak performance” of a given software application.
By employing techniques and focusing on the activities of:
Monitoring and observability
Testing
Analysis and team adoption
to embracing software quality assurance
0%
Up to
A combination of studies show that poor user experience will directly impact businesses’ conversion rate from 1% up to 11%.
Beside customer’s dissatisfaction and other negative factors
According to various source/references
Addressing
Scalability
Reliability
Resource utilization
Overall user experience
Addressing
Responsiveness
Scalability
Reliability
Resource utilization
Overall user experience
Monitoring & Observability
Is knowing
On Infrastructure(environment) and application level.
Application Performance Monitoring (APM) and Observability techniques and tools facilitates the analysing of health, performance and the overall user experience of a given software.
Monitoring is capturing and displaying data,
while observability is understanding and evaluating the internal state by analysing
Logs
Metrics (gauge, delta metrics, cumulative)
Distributed tracing
Monitoring & Observability
Is knowing
On Infrastructure(environment) and application level.
Application Performance Monitoring (APM) and Observability techniques and tools facilitates the analysing of health, performance and the overall user experience of a given software.
Monitoring is capturing and displaying data,
while observability is understanding and evaluating the internal state by analysing
Logs
Metrics (gauge, delta metrics, cumulative)
Distributed tracing
Pillars of Monitoring & Observability
Full-stack overview
Clarity. Data-driven
Utilize resources on cloud/infrastructure
Reduced MTTD & MTTR
Real time monitoring of security
Errors and configuration issues
Centralized data
Business value. Decisions, improve customer experience, responsiveness, and satisfaction.
1st
of 20
For 12 consecutive years.
Dynatrace is the number one “Leader” in Gartner’s Magic Quadrant for Application Performance Monitoring and Observability tools.
Sorintains offering the service are certified experts.
*Gartner June 2022
Pillars of Monitoring & Observability
Full-stack overview
Clarity. Data-driven
Utilize resources on cloud/infrastructure
Reduced MTTD & MTTR
Real time monitoring of security
Errors and configuration issues
Business value. Decisions, improve customer experience, responsiveness, and satisfaction.
Centralized data
1st
of 20
For 12 consecutive years.
Dynatrace is the number one “Leader” in Gartner’s Magic Quadrant for Application Performance Monitoring and Observability tools.
Sorintains offering the service are certified experts.
Dynatrace is the number one “Leader” in Gartner’s Magic Quadrant for Application Performance Monitoring and Observability tools.
Sorintains offering the service are certified experts.
*Gartner June 2022
Testing
Keystone to ensure the best user experience
Functional and non-functional testing
The process of evaluating a software code, application, or system to identify bugs, defects, or functional issues. Ensure project meets requirements.
Testing
Keystone to ensure the best user experience
Functional and non-functional testing
The process of evaluating a software code, application, or system to identify bugs, defects, or functional issues. Ensure project meets requirements.
Types of Testing
Assess the functionality of a software in operation in various contexts. BE – FE – DB – Infra
Performance, resilience, and availability
Types of test that help ensure that the software performs optimally, is robust in handling failures, and remains available to users when needed.
End-To-End
Using simulated real data, the test focuses on verifying real-life scenarios that will then be execute by the end user, validating build stability and data integrity. The scripts can be repurposed and reused in regression testing.
Regression
Performed to validate that changes made have not introduced new defects or caused any regression in existing functionality. Involves retesting the previously tested features to ensure they still work correctly.
User acceptance (UAT)
Involves testing the software from the user’s perspective to ensure that it fulfils the intended purpose and meets user/clients requirements.
Types of Testing
Assess the functionality of a software in operation in various contexts. BE – FE – DB – Infra
Performance, resilience, and availability
Types of test that help ensure that the software performs optimally, is robust in handling failures, and remains available to users when needed.
End-To-End
Using simulated real data, the test focuses on verifying real-life scenarios that will then be execute by the end user, validating build stability and data integrity. The scripts can be repurposed and reused in regression testing.
Regression
Performed to validate that changes made have not introduced new defects or caused any regression in existing functionality. Involves retesting the previously tested features to ensure they still work correctly.
User acceptance (UAT)
Involves testing the software from the user’s perspective to ensure that it fulfils the intended purpose and meets user/clients requirements.
Analysis & Team Adoption
How to approach
Assessment of project team’s competencies, training, communication, and collaboration (flow and responsibilities).
Key factors:
Methodologies
Inspections
Requirements definition service application/architecture
CI/CD, version control, branching strategy
Design, code reviews, & code quality
Testing strategy & testing environment
Test planning, case design, execution, analysis, reporting
Monitoring & observability techniques and tools
Analysis & Team Adoption
How to approach
Assessment of project team’s competencies, training, communication, and collaboration (flow and responsibilities).
Key factors:
Methodologies
Inspections
Requirements definition service application/architecture
CI/CD, version control, branching strategy
Design, code reviews, & code quality
Testing strategy & testing environment
Test planning, case design, execution, analysis, reporting
Monitoring & observability techniques and tools
SORINT.lab Tailored Journey
Embracing Software Quality Assurance
Application performance
Monitoring & Observability
Defect Tracking, management and continuous monitoring
Analysis & Team adoption
Defining Quality Standards
Requirement Analysis
Documentation and Reporting
Compliance and Standards
Testing
Test Planning
Test Execution
SORINT.lab’s Tailored Journey
Embracing Software Quality Assurance
Application performance
Monitoring & Observability
Defect Tracking, management and continuous monitoring
Analysis & Team adoption
Defining Quality Standards
Requirement Analysis
Documentation and Reporting
Compliance and Standards
Testing
Test Planning
Test Execution
SORINT.lab’s Tailored Journey
Know-how
Every journey is a unique challenge, but our know-how to the key aspects:
Clear Quality Objectives
Well-defined
QA Processes
Skilled team
Tools Knowledge
Test coverage
Test automation
Metrics & Reporting
Continuous improvement
SORINT.lab’s Tailored Journey
Know-how
Every journey is a unique challenge, but our know-how to the key aspects:
Clear Quality Objectives
Well-defined
QA Processes
Skilled team
Tools Knowledge
Test coverage
Test automation
Metrics & Reporting
Continuous improvement
SORINT.lab’s Tailored Journey
The make it model approach is instantiated from
Industries
Nourished experience from huge variety of business sectors.
At least 15
Adaptation
Adapting to client and project’s needs, technologies and context
Meticulous compliance
Extensive knowledge of “highly regulated” industries
Agility
Easy access to full-stack and cross functional expertise
Involvement
Imparting knowledge, support and resources to help acquire the skills necessary
Automation
A mechanism aiming to streamline operations
SORINT.lab’s Tailored Journey
The make it model approach is instantiated from
Industries
Nourished experience from huge variety of business sectors.
At least 15
Adaptation
Adapting to client and project’s needs, technologies and context
Meticulous compliance
Extensive knowledge of “highly regulated” industries
Agility
Easy access to full-stack and cross functional expertise
Involvement
Imparting knowledge, support and resources to help acquire the skills necessary
Automation
A mechanism aiming to streamline operations
Experts Involved
Giorgio Cassia
QA Test Engineer Functional & Non-functional Specialist
+5 years of experience in developing &testing sftw.
Prestigious Certificates
Other sircles and specialisation involved
Application Performance
DevArch
NGMS
CI/CD DevOps Engineering
Other tech related sircles
Closer Look
Areas and field of focus
Monitoring & Observability
- Full stack, End-End monitoring.
- From tools, configurating, reading outputs, consultation, to reporting and educating
- Infrastructure, application, user experience and log
Testing
- Planning to execution and reporting
- Methodology of testing
- Testing Culture and know-how
- Implement automation testing and custom framework testing
Analysis and Team Adoption
- Proved analysis reports and advice on problem solving and required QA improvements.
- Embrace QA culture and know-how
NGMS Support
- Level 1 – 2 – 3 of support
- 24×7 Service plans
All the journey
Side by side with client’s team
Closer Look
Areas and field of focus
Monitoring & Observability
- Full stack, End-End monitoring
- From tools, configurating, reading outputs, consultation, to reporting and educating
- Infrastructure, application, user experience and log
Testing
- Planning to execution and reporting
- Methodology of testing
- Testing Culture and know-how
- Implement automation testing and custom framework testing
Analysis and Team Adoption
- Proved analysis reports and advice on problem solving and required QA improvements
- Embrace QA culture and know-how
NGMS Support
- Level 1 – 2 – 3 of support
- 24×7 Service plans
All the journey
Side by side with client’s team
Some Common Tools
Partners and certified instructors to many!
Application monitoring & observability full stack (APM)
Performance test
End-to-End –Regression / Mobile
Application monitoring open Source
Resilience test
Some Common Tools
Partners and certified instructors to many!
Application monitoring & observability full stack (APM)
Performance test
End-to-End –Regression / Mobile
Application monitoring open Source
Resilience test
Success Stories
Delivered by: SORINTians
European Certification Authority and Digital Trust Leader
Automated End-To-End Testing
1) Challenge
Client’s requirement included:
- Introduce the concept of “testing application” in the enterprise.
- Introduce automated E2E testing to some software applications.
2) Goind forward
Carried out regular assessment-based meeting
to understands the environment and Client’s team skills.
3) Accepting the challenge – Solution and Implementation
In a proposal form. We divided the solution into three phases
- Phase 1: Details on the testing strategy, implementation + vendor selection
- Phase 2: Timing, Solution info, testing info, team involvement
- Phase 3: Details on the tool, how to create tests, methodology. Test source files
Result & delivery
- In total we delivered 13 file features. 120 Test cases.
- Integrated tests in CI pipelines.
- Client’s team involvement. Introduces and practice BDD methodology.
- Shared a hands-on experience and knowledge to client’s team in various projects.
- Project expanded to include application performance monitoring (APM) and
- Observability on more applications.
A Leading Healthcare Provider in Italy
Monitoring Application Performance
1) Challenge
- Complete coverage of everything happening on app and infrastructure level.
- Identify optimal size of infrastructure’s resources and eliminate waste
- Detect issues with calls to 3rd party services.
- Main activities happen on the core application. Impacts the quality of service and the operation-side of the hospital
- Poor synergy with software vendor.
2) Goind forward
Carried out regular assessment
3) Accepting the challenge – Solution and Implementation
In a proposal form. The solution proposed was divided into 4 phases:
Titled as POC, Monitoring CUPS, Customization, Analysis.
- POC includes design for several units operating in the hospital.
- Monitoring CUPS which focused on the implementation of the backend replacement
- Customization user action, dashboard, availability test, session replay…
- Analysis and consultation on slowdowns, application exceptions/errors, slow or overly burdensome queries
- Problems with 3rd party services.
Result & delivery
- No impacting problems recorded during Going live and now.
- Intelligent monitoring with full stack observability.
Examples of issues detected are:
- Error on request http 4xx / 5xx with stacktrace code level
- User action slowdown related issues.
- Performance trends. E.g. non optimized queries
- Libraries/service subject to security vulnerability e.g. (logj4)
Success Stories
Delivered by: SORINTians
European Certification Authority and Digital Trust Leader
Automated End-To-End Testing
1) Challenge
Client’s requirement included:
- Introduce the concept of “testing application” in the enterprise.
- Introduce automated E2E testing to some software applications.
2) Goind forward
Carried out regular assessment-based meeting
to understands the environment and Client’s team skills.
3) Accepting the challenge – Solution and Implementation
In a proposal form. We divided the solution into three phases
- Phase 1: Details on the testing strategy, implementation + vendor selection
- Phase 2: Timing, Solution info, testing info, team involvement
- Phase 3: Details on the tool, how to create tests, methodology. Test source files
Result & delivery
- In total we delivered 13 file features. 120 Test cases.
- Integrated tests in CI pipelines.
- Client’s team involvement. Introduces and practice BDD methodology.
- Shared a hands-on experience and knowledge to client’s team in various projects.
- Project expanded to include application performance monitoring (APM) and
- Observability on more applications.
A Leading Healthcare Provider in Italy
Monitoring Application Performance
1) Challenge
- Complete coverage of everything happening on app and infrastructure level.
- Identify optimal size of infrastructure’s resources and eliminate waste
- Detect issues with calls to 3rd party services.
- Main activities happen on the core application. Impacts the quality of service and the operation-side of the hospital
- Poor synergy with software vendor.
2) Goind forward
Carried out regular assessment
3) Accepting the challenge – Solution and Implementation
In a proposal form. The solution proposed was divided into 4 phases:
Titled as POC, Monitoring CUPS, Customization, Analysis.
- POC includes design for several units operating in the hospital.
- Monitoring CUPS which focused on the implementation of the backend replacement
- Customization user action, dashboard, availability test, session replay…
- Analysis and consultation on slowdowns, application exceptions/errors, slow or overly burdensome queries
- Problems with 3rd party services.
Result & delivery
- No impacting problems recorded during Going live and now.
- Intelligent monitoring with full stack observability.
Examples of issues detected are:
- Error on request http 4xx / 5xx with stacktrace code level
- User action slowdown related issues.
- Performance trends. E.g. non optimized queries
- Libraries/service subject to security vulnerability e.g. (logj4)
Related Solutions and Tools by SORINTians
Open-source software product
Agola is a CI/CD system with a lot of great features like advanced and reproducible workflows (runs), containerized tasks, fully distributed, high-available and much more. Featured on Cloud Native Landscape.
Digital Technology Services
SSL promotes security as a common responsibility shared by all teams involved in software development. The service follows DevSecOps as a methodology.
Related Solutions and Tools by SORINTians
We are all ears!
Welisten
24x7x365
Whether you have any doubts, interested to know more about our offerings, want more relevant case studies, would like to arrange a consultation, or don’t see what you are looking for here, we’d love to hear from you.
We are all ears!
Welisten
24x7x365
Whether you have any doubts, interested to know more about our offerings, want more relevant case studies, would like to arrange a consultation, or don’t see what you are looking for here, we’d love to hear from you.