X

Software QA & Test

Testing at Augmentum

At Augmentum we emphasize the importance of QA for all our software professionals. We support a dual but equal career ladder for development and QA engineers. QA training is required and an intrinsic part of our staff rotation and career planning.

We have designed, developed, and implemented disciplined and sophisticated test methodologies covering the creation of test plans, the design and execution of test cases, test risk identification and management, and the development of meaningful acceptance criteria for companies ranging from multibillion dollar Fortune 100 to early stage startups. Augmentum offers integrated manual and automated test practices that can be wholly customized depending on customer needs. We have expertise across all major operating systems; database systems; messaging and EAI; application servers and web services; open source stacks: .Net/Java/PHP/C, C++; user interface and user experience; device drivers; storage sub-systems; mobile phones; CPU-related firmware. Representative examples of Augmentum capabilities include:

  • Device testing at operating system, UI, and 3rd party application levels
  • Storage system and driver testing
  • Database connectivity (JDBC, ODBC) testing
  • Usability (UE/UI) testing of devices and applications
  • Performance, endurance, stress, and load testing for devices and applications

Manual Testing Practice

Augmentum offers manual testing services to our customers in the following areas: system/integration/functionality/feature testing; use case/scenario based end-user testing; acceptance testing; sanity testing; validation and verification testing.

Our manual testing process is mature and full-featured. Augmentum will create test cases and review existing test cases for retrofit and update, as well as analyze the gap between what is being tested, what has been implemented, and what is required. We manage test cases with a disciplined approach including feature test coverage matrix.

During test case execution, we pay attention to the details of bug recording, bug reporting, bug tracking, and bug management. We define, collect, and analyze metrics to understand the effectiveness of our teams’ bug finding and the relevant bug categories. We perform bug lifecycle analysis to highlight reopened bugs, bug age and phase in which bugs were found. Finally, at the end of every QA cycle we perform a postmortem to identify any critical bugs missed during testing or any mislabeled bugs (wrong categorization, severity, priority), and to develop input to our continuous improvement process.

Automated Testing Practice

Traditional methodologies used in testing software usually face an immovable barrier – time. As software approaches the release phase, regression bugs in particular become more difficult to detect before they become showstoppers. For software in the development phase, early detection of bugs is a critical part of building a solid foundation.

The problem is compounded in an enterprise software or mobile computing environment. For these teams, releasing products for different locales simultaneously – without compromising on the quality of the products – in an environment where the target hardware platform is changing rapidly or added in response to market demand, and is evolving in different ways, up and down the stack, in different places, increases the demands on test and QA. Augmentum’s Automated Testing practice enables our customers to shift more of their bug discovery and fixing to their early stage of the development cycle, leading to a software release with the lowest total cost for high quality.

cost_of_bugs_in_release_cycle

Automation of test cases does require concerted efforts from both development and QA teams as it requires a methodical approach to create the automation test framework and build automated test cases. Augmentum’s Automated Testing practice contributes to the overall success of product development as we allow our customers’ development and QA teams to focus on core competencies in product development. Augmentum offers the following automated test development services:

  • Unit testing automation
  • System/integration/functionality/feature testing automation
  • Load/stress/performance testing automation

Augmentum supports many automation tools and environments, ranging from commercially available tools to open source tools to highly customized automation testing frameworks. Please contact us if there are other tools that you would like to investigate.

Representative example of Augmentum capabilities:

Commercially Available Tools Open Source Tools
SilkTest®

  • Windows application/web application UI testing automation
  • Handheld device OS testing automation
  • Localization UI testing automation
  • Installation and configuration testing automation

Mercury™ Products

  • Functional testing and load testing automation
  • TestMaker
  • Performance and load testing and reporting
  • HTTPTest
  • TestMaker
  • Canoo WebTest
  • xUnit
  • HttpUnit
  • HtmlUnit
  • JsUnit
  • IeUnit
  • JMeter

For other customers, Augmentum develops specialized automation testing frameworks based on specific business and technical requirements that are not readily addressed by commercial or open source tools.