Welcome!

@DevOpsSummit Authors: Yeshim Deniz, Pat Romanski, Mehdi Daoudi, Elizabeth White, Liz McMillan

Related Topics: @DevOpsSummit, Containers Expo Blog

@DevOpsSummit: Blog Post

How API Testing Helps the Netherlands | @DevOpsSummit #API #DevOps

Learn how they reduced testing time for new releases from 3 weeks to just 1 day

How API Testing Helps the Netherlands Ensure the Security and Reliability of its Nationwide ID System

The Netherlands recently rolled out a new personal identification system, dubbed the Citizen Service Number (CSN), on a nationwide basis. The CSN is used by health care organizations, governmental entities and immigration officials to ensure proper identification and enable the provision of relevant services.

Considering the importance of this advanced system to the welfare and support of all citizens, the Dutch Ministry of Internal Affairs, which was responsible for its roll out, focused on ensuring that the system's performance was exceedingly high. Fortunately, the ministry was able to meet its ambitious objectives within a demanding time frame.

Using the top-ranked functional test automation / API testing tool, the organization reduced testing time for new releases of CSN from three weeks to just one day. This enabled the ministry to accelerate the project's completion while maintaining top levels of software quality. Through regression and load testing, the organization has certified the system's ability to handle 100 million transactions a year with a peak load of 200 transactions per second.

Challenge: Build a Robust and Secure CSN System
When the Dutch government decided it needed a new system for integrating and managing citizen records and information for identification purposes, it turned to the Ministry of Internal Affairs. The organization, one of 13 government ministries in The Netherlands, is responsible for ensuring the integrity of personal records and documents including travel documents and passports. Agency BPR, a unit overseeing personal document management within the ministry, was given the task of designing, developing and certifying a new system that could handle this momentous task.

The high profile initiative, which would be known as the Citizen Service Number (CSN), demanded that the ministry build a highly robust and secure system within an aggressive timeframe. Not only will performance of the system be closely observed upon roll out, expectations will be extremely high. There is little margin for error. Given these requirements, the ministry recognized early that it would need to take an advanced approach toward software quality management.

Clearly, the stakes were high. "This was going to become the only identification number for citizens of The Netherlands," says Hedde van der Lugt, the CSN project leader in Agency BPR. "It needed to enhance the efficiency of government and improve services to citizens. We were responsible for ensuring the integrity of the system."

At launch time, the initiative's project team was clearly off to a successful start in terms of its programming efforts. It was software testing that needed to be rethought. Test data was being laid out in Excel spreadsheets, which then had to be laboriously copied into current testing tools for regression and load testing. "We released software quickly, but testing was slow in relation to release frequency," adds van der Lugt. "We needed a testing solution to help us gain time."

Given the manual nature of existing approaches, it was taking more than three weeks to complete all functional tests. That was an unacceptably slow pace. So, the ministry's system development team began exploring other alternatives.

Action: Selecting an Automated API Testing Tool that Suited Their Needs
In a thorough assessment of market options, Agency BPR examined proprietary and open source products from an array of sources. It considered multiple technical and security criteria. It also looked at the availability of local service and support. Finally, it took pricing and cost effectiveness into consideration.

Ultimately, the unit concluded that Parasoft's API Testing solution was the appropriate solution to its challenges. Other tools required extensive scripting or performed poorly in relation to SSL security protocols, or simply cost too much to license.

The Parasoft API Testing solution enabled the effective automation of performance, stress and load testing - critical to ensure the robustness and security of the system. "Parasoft's API Testing solution was clearly the easiest product to work with," says Martin Folkerts, the project's test coordinator. "That was a key issue for us. The users of the testing tools were not programmers. We knew the tool had to be very user friendly."

The ministry chose to apply API Testing in multiple ways. First, the development group conducted regression tests, ensuring no defects had been introduced in new versions and that previously verified code continued to meet its specifications. Second, they performed load and stress testing to ensure that the system was robust enough to meet exacting demands. Finally, they completed functional testing once their application development partner completed each new release.

Using this test automation, new releases installed in production are accessed by a 10 minute "go, no go" test run to determine the correct installation in production. If there are errors that remain to be corrected, the software code can be sent back to the partner. But if the release is demonstrably stable and secure, then it is incorporated into the system.

Folkerts describes the actual deployment of Parasoft's API Testing solution as "very easy." As he explains, "The only thing we had to do was put the test data in a format that the solution could easily read. Then, I made a document explaining Parasoft's API Testing solution to our team in a couple of days. It was a fairly easy transition. Before this, the testers had to do a lot of copying and pasting so they were very happy with this new approach."

Results: Speeding Up the Software Development Lifecycle
The payoffs associated with the Parasoft investment have proven very significant. Most importantly, the introduction of Parasoft's API Testing solution reduced functional testing periods from three weeks to merely one day. "The software offered us significant gains in productivity," says van der Lugt. "We could generate many more release test cycles within a given timeframe."

Indeed, the ministry's development team also saw the productivity of its testing group rise measurably. "The work changed from manual labor to the development of interesting test cases," says Folkerts. "A lot of manual labor disappeared and was outmoded. This enabled us to speed up the development cycle. We could now generate a release every three days instead of every three weeks."

Such efforts represented huge wins for the ministry charged with the monumental task of rolling out the new system to serve 16 million Dutch citizens. Through a combination of regression, functional and load testing, the organization has certified the system's ability to handle 100 million transactions a year with a peak load of 200 transactions per second.

Parasoft's automated testing infrastructure enabled the ministry to easily leverage functional test cases into load tests to simulate a realistic load on the system. The development team's ability to perform high quality load tests in an automated fashion, meanwhile, clearly accelerated the project's completion.

"It's essential that the integrity of the system is guaranteed," says van der Lugt. "We believe Parasoft's API Testing solution has helped us to guarantee 100% reliability of this system in a more rapid fashion than otherwise would have been possible. It's a valuable product that has covered all our needs."

More Stories By Cynthia Dunlop

Cynthia Dunlop, Lead Content Strategist/Writer at Tricentis, writes about software testing and the SDLC—specializing in continuous testing, functional/API testing, DevOps, Agile, and service virtualization. She has written articles for publications including SD Times, Stickyminds, InfoQ, ComputerWorld, IEEE Computer, and Dr. Dobb's Journal. She also co-authored and ghostwritten several books on software development and testing for Wiley and Wiley-IEEE Press. Dunlop holds a BA from UCLA and an MA from Washington State University.

@DevOpsSummit Stories
While DevOps most critically and famously fosters collaboration, communication, and integration through cultural change, culture is more of an output than an input. In order to actively drive cultural evolution, organizations must make substantial organizational and process changes, and adopt new technologies, to encourage a DevOps culture. Moderated by Andi Mann, panelists discussed how to balance these three pillars of DevOps, where to focus attention (and resources), where organizations might slip up with the wrong focus, how to manage change and risk in all three areas, what is possible and what is not, where to start, and especially how new structures, processes, and technologies can help drive a new DevOps culture.
After more than five years of DevOps, definitions are evolving, boundaries are expanding, ‘unicorns’ are no longer rare, enterprises are on board, and pundits are moving on. Can we now look at an evolution of DevOps? Should we? Is the foundation of DevOps ‘done’, or is there still too much left to do? What is mature, and what is still missing? What does the next 5 years of DevOps look like? In this Power Panel at DevOps Summit, moderated by DevOps Summit Conference Chair Andi Mann, panelists looked back at what DevOps has become, and forward at what it might create next.
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Meanwhile, 94% of enterprises are using some form of XaaS – software, platform, and infrastructure as a service.
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
SYS-CON Events announced today that Ayehu will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara California. Ayehu provides IT Process Automation & Orchestration solutions for IT and Security professionals to identify and resolve critical incidents and enable rapid containment, eradication, and recovery from cyber security breaches. Ayehu provides customers greater control over IT infrastructure through automation. Ayehu solutions have been deployed by major enterprises worldwide, and currently, support thousands of IT processes across the globe. The company has offices in New York, California, and Israel.
SYS-CON Events announced today that MobiDev, a client-oriented software development company, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MobiDev is a software company that develops and delivers turn-key mobile apps, websites, web services, and complex software systems for startups and enterprises. Since 2009 it has grown from a small group of passionate engineers and business managers to a full-scale mobile software company with over 200 developers, designers, quality assurance engineers, project managers in house, specializing in the world-class mobile and web development.
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market across the USA and Europe, we work with a variety of customers from emerging startups to Fortune 1000 companies.
"We are a monitoring company. We work with Salesforce, BBC, and quite a few other big logos. We basically provide monitoring for them, structure for their cloud services and we fit into the DevOps world" explained David Gildeh, Co-founder and CEO of Outlyer, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential.
SYS-CON Events announced today that Enzu will exhibit at SYS-CON's 21st Int\ernational Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enzu’s mission is to be the leading provider of enterprise cloud solutions worldwide. Enzu enables online businesses to use its IT infrastructure to their competitive advantage. By offering a suite of proven hosting and management services, Enzu wants companies to focus on the core of their online business and let Enzu manage their IT hosting infrastructure.
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists examined how DevOps helps to meet the demands of Digital Transformation – including accelerating application delivery, closing feedback loops, enabling multi-channel delivery, empowering collaborative decisions, improving user experience, and ultimately meeting (and exceeding) business goals.
Cloud Expo, Inc. has announced today that Andi Mann and Aruna Ravichandran have been named Co-Chairs of @DevOpsSummit at Cloud Expo Silicon Valley which will take place Oct. 31-Nov. 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. "DevOps is at the intersection of technology and business-optimizing tools, organizations and processes to bring measurable improvements in productivity and profitability," said Aruna Ravichandran, vice president, DevOps product and solutions marketing, CA Technologies. "It's this results-driven combination of technology and business that makes me so passionate about DevOps and its future in the industry. I am truly honored to take on this co-chair role, and look forward to working with the DevOps Summit team at Cloud Expo and attendees to advance DevOps."
SYS-CON Events announced today that Cloud Academy named "Bronze Sponsor" of 21st International Cloud Expo which will take place October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara, CA. Cloud Academy is the industry’s most innovative, vendor-neutral cloud technology training platform. Cloud Academy provides continuous learning solutions for individuals and enterprise teams for Amazon Web Services, Microsoft Azure, Google Cloud Platform, and the most popular cloud computing technologies. Get certified, manage the full lifecycle of your cloud-based resources, and build your knowledge based using Cloud Academy’s expert-created content, comprehensive Learning Paths, and innovative Hands-on Labs.
What's the role of an IT self-service portal when you get to continuous delivery and Infrastructure as Code? This general session showed how to create the continuous delivery culture and eight accelerators for leading the change. Don Demcsak is a DevOps and Cloud Native Modernization Principal for Dell EMC based out of New Jersey. He is a former, long time, Microsoft Most Valuable Professional, specializing in building and architecting Application Delivery Pipelines for hybrid legacy, and cloud native applications.
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
In the world of DevOps there are ‘known good practices’ – aka ‘patterns’ – and ‘known bad practices’ – aka ‘anti-patterns.' Many of these patterns and anti-patterns have been developed from real world experience, especially by the early adopters of DevOps theory; but many are more feasible in theory than in practice, especially for more recent entrants to the DevOps scene. In this power panel at @DevOpsSummit at 18th Cloud Expo, moderated by DevOps Conference Chair Andi Mann, panelists discussed the patterns and anti-patterns of DevOps, and what it means to ‘do the right thing’ in a DevOps way, but in the real world.
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the application economy. With CA software at the center of their IT strategy, organizations can leverage the technology that changes the way we live - from the data center to the mobile device. CA's software and solutions help customers thrive in the new application economy by delivering the means to deploy, monitor and secure their applications and infrastructure.
Both SaaS vendors and SaaS buyers are going “all-in” to hyperscale IaaS platforms such as AWS, which is disrupting the SaaS value proposition. Why should the enterprise SaaS consumer pay for the SaaS service if their data is resident in adjacent AWS S3 buckets? If both SaaS sellers and buyers are using the same cloud tools, automation and pay-per-transaction model offered by IaaS platforms, then why not host the “shrink-wrapped” software in the customers’ cloud? Further, serverless computing, cloud marketplaces and DevOps are changing the economics of hosting and delivering software.
"When we talk about cloud without compromise what we're talking about is that when people think about 'I need the flexibility of the cloud' - it's the ability to create applications and run them in a cloud environment that's far more flexible,” explained Matthew Finnie, CTO of Interoute, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
Wooed by the promise of faster innovation, lower TCO, and greater agility, businesses of every shape and size have embraced the cloud at every layer of the IT stack – from apps to file sharing to infrastructure. The typical organization currently uses more than a dozen sanctioned cloud apps and will shift more than half of all workloads to the cloud by 2018. Such cloud investments have delivered measurable benefits. But they’ve also resulted in some unintended side-effects: complexity and risk. End users now struggle to navigate multiple environments with varying degrees of performance. Companies are unclear on the security of their data and network access. And IT squads are overwhelmed trying to monitor and manage it all.
It is ironic, but perhaps not unexpected, that many organizations who want the benefits of using an Agile approach to deliver software use a waterfall approach to adopting Agile practices: they form plans, they set milestones, and they measure progress by how many teams they have engaged. Old habits die hard, but like most waterfall software projects, most waterfall-style Agile adoption efforts fail to produce the results desired. The problem is that to get the results they want, they have to change their culture and cultures are very hard to change. To paraphrase Peter Drucker, "culture eats Agile for breakfast." Successful approaches are opportunistic and leverage the power of self-organization to achieve lasting change.
In 2014, Amazon announced a new form of compute called Lambda. We didn't know it at the time, but this represented a fundamental shift in what we expect from cloud computing. Now, all of the major cloud computing vendors want to take part in this disruptive technology. In his session at 20th Cloud Expo, Doug Vanderweide, an instructor at Linux Academy, discussed why major players like AWS, Microsoft Azure, IBM Bluemix, and Google Cloud Platform are all trying to sidestep VMs and containers with heavy investments in serverless computing, when most of the industry has its eyes on Docker and containers.
@DevOpsSummit at Cloud Expo taking place Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center, Santa Clara, CA, is co-located with the 21st International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential.
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the application economy. With CA software at the center of their IT strategy, organizations can leverage the technology that changes the way we live - from the data center to the mobile device. CA's software and solutions help customers thrive in the new application economy by delivering the means to deploy, monitor and secure their applications and infrastructure.