|By Jason Bloomberg||
|July 24, 2014 08:26 AM EDT||
Balancing Automation and Human Knowledge Curation
There are many metadata management tools on the market today, including Configuration Management Databases (CMDBs) and Service-Oriented Architecture (SOA) Repositories, to name a few. Such tools seek to automate the collection and dissemination of policy-related metadata in hopes of automating policy enforcement – an important part of the automated governance critical to achieving business agility. And yet, such tools have generally fallen short, because they inadequately address the need to support policies that apply primarily to human behavior.
In contrast, there are many tools on the market that focus primarily on supporting human collaboration and communication, either across an organization or specific to particular teams, processes, or tasks. Such tools include portals like Microsoft SharePoint, groupware of various sorts (email, wikis, and the like), and more focused tools such as Portfolio Management or Application Lifecycle Management (ALM) products.
When it comes to driving business agility across the organization, however, such human communication and collaboration tools have also fallen short, as they generally require an onerous amount of configuration and management from people who have scant time or attention to devote to such dull activities. This limitation leads to bloated repositories full of unsearchable documents, or email inboxes with thousands of messages, or knowledge management systems that contain information that is so out of date and incomplete that people refuse to spend any time updating them, thus defeating their purpose entirely.
ITinvolve has largely solved this combination of problems with their aptly-named Agility Manager. Agility Manager can be thought of as a next-generation knowledge management application that combines automated metadata collection and policy enforcement with broad human curation capabilities, balancing the need for automated governance and support for human activities within software development teams or more broadly across the organization.
Agility Manager also adds a set of objects to aid in projects including business goal, release, and iteration objects, as well as project planning functionality like Gantt charting and Kanban boards, as shown in the figure below. Furthermore, data need not physically reside in ITinvolve but can be federated so the object relationships are in ITinvolve but the full data set lives in a third-party source, for example, a pdf-formatted policy document on a file share or detailed functional requirements in Atlassian JIRA or Rally Software’s ALM platform.
Furthermore, the entire ITinvolve suite of applications (Agility Manager plus some value-added extensions) are Software-as-a-Service (SaaS) applications built on the Salesforce1 Platform. This platform choice gives ITinvolve customers pay-as-you-go, per-user pricing that simplifies onboarding and ramping up, as well as the scalability and integration support you’d expect from Salesforce.
The ITinvolve Agile Architecture Story
Architecting for business agility in the enterprise requires far more than the proper application of architectural practices to Agile development projects. In fact, it requires a complete rethink of what it means to architect an organization. Business agility is a property of the organization as a whole, which means that the enterprise must be treated as a Complex Adaptive System, where business agility is an emergent property of the system.
Such Complex Systems are actually systems of systems; in the case of an organization, the component systems are technology systems and people. The challenge of architecting for business agility, therefore, extends beyond architecting the technology. It’s also critical for the organization to architect its people as well.
The way to “architect the people” in the organization is to apply appropriate governance policies and processes that encourage the desired behavior. Excessive or inappropriate governance typically backfires, however, as too many rules and policies can lower morale and productivity. Instead, it’s important to encourage desired behavior via effective incentives, coupled with tools that facilitate the desired behavior, yet make undesirable behavior difficult. To this end, ITinvolve empowers people so that they are willing and even desirous to adapt their behavior. ITinvolve helps people facilitate their work by giving them the information and analysis they require, and enabling collaboration with other relevant team members (even ones they may not know about).
Giving people better tools and rewarding them with free food or cash bonuses is only part of the story. In order to achieve the business agility goals of the organization, this human governance must be seamlessly integrated with the automated governance of technology. In other words, technology must support the desired human behavior by providing the right tools, but people must also be able to properly manage and govern the technology in order to support the flexibility necessary for the organization to be agile.
Furthermore, as emergent behavior is inherently unpredictable, it is essential that organizations take an iterative approach to directing human and technology behavior in order to increase the organization’s agility. Each iteration should include a feedback loop that reflects the resulting effects of any policy or tooling change in order to improve results of subsequent iterations.
ITinvolve’s combined automated governance and human curation approach brings together the essential elements of this Agile Architecture story. At its core, the Agility Manager is an application that simplifies and encourages the desired behavior from the teams using the application. It also supports multiple approaches to automating the collection and communication of necessary metadata, as well as the automation of policies.
Instead of discouraging active participation in knowledge collection as standard portals and knowledge management tools do, ITinvolve empowers people to share their knowledge, as shown in the figure below. This approach facilitates cross-team collaboration on projects and decisions by supporting more effective risk management using current and accurate information. As a result, people can get their jobs done and make better decisions by fully understanding the various dependencies among requirements, policies, applications, and other elements of their work environment.
ITinvolve also brings together and integrates varied data sources, including documents on portals, metadata in asset management tools and CMDBs, automation scripts and recipes, and other information that would otherwise be scattered about the organization or locked up in the heads of key personnel. This “tribal knowledge” of each expert in the enterprise is a critical asset that is always at risk of being lost, either through people leaving the organization, or simply forgetting the details over time.
Not only does ITinvolve facilitate the collection and dissemination of such tribal knowledge, but the application also supports the continuous review of such information by other experts in the organization. The result is an iterative, continuous-feedback approach to ongoing improvement of the information that ITinvolve manages. In fact, by bringing various individuals together from across different departments within the organization, ITinvolve supports flexible collaboration across the enterprise. Such cross-silo collaboration is critical for Agile projects, DevOps, and other initiatives that drive greater agility in the enterprise.
The Intellyx Take
One area where Agile development methodologies and the Agile Architecture approach to treating the organization as a Complex Adaptive System overlap is with the focus on self-organizing teams. Top-down approaches to creating teams – essentially, managers formally assigning roles to individuals – limit the flexibility of the team and thus impact the agility of the organization. Allowing teams to organize themselves addresses this issue.
And yet, as teams expand beyond a handful of people, especially when such teams are cross-functional and involve a variety of people in different roles, then self-organization can potentially begin to break down. The challenge isn’t necessarily the competency of the individuals involved, but rather their ability to communicate effectively and maintain coherent, up-to-date tribal knowledge, even as the team’s personnel might change or their tasks may evolve.
Solving this challenge is central to ITinvolve’s value proposition, because it both facilitates and supports the self-organization so critical to Agile teams, while at the same time addressing the communication and knowledge management challenges endemic to cross-functional teams. As a result, ITinvolve fosters a self-regulating system that provides greater transparency to all team members and management alike, as well as automated constraints on the behavior of associated technology assets, in such a way that facilitates the iterative feedback loop essential to driving agility long-term in large organizations.
ITinvolve is an Intellyx client. Intellyx retains full editorial control over the content of this post.
Learn how to solve the problem of keeping files in sync between multiple Docker containers. In his session at 16th Cloud Expo, Aaron Brongersma, Senior Infrastructure Engineer at Modulus, discussed using rsync, GlusterFS, EBS and Bit Torrent Sync. He broke down the tools that are needed to help create a seamless user experience. In the end, can we have an environment where we can easily move Docker containers, servers, and volumes without impacting our applications? He shared his results so you can decide for yourself.
Jul. 28, 2015 07:15 PM EDT Reads: 708
How do you securely enable access to your applications in AWS without exposing any attack surfaces? The answer is usually very complicated because application environments morph over time in response to growing requirements from your employee base, your partners and your customers. In his session at @DevOpsSummit, Haseeb Budhani, CEO and Co-founder of Soha, shared five common approaches that DevOps teams follow to secure access to applications deployed in AWS, Azure, etc., and the friction and risks they impose on the business.
Jul. 28, 2015 03:30 PM EDT Reads: 476
Containers are changing the security landscape for software development and deployment. As with any security solutions, security approaches that work for developers, operations personnel and security professionals is a requirement. In his session at DevOps Summit, Kevin Gilpin, CTO and Co-Founder of Conjur, will discuss various security considerations for container-based infrastructure and related DevOps workflows.
Jul. 28, 2015 01:00 PM EDT Reads: 1,043
Puppet Labs has announced the next major update to its flagship product: Puppet Enterprise 2015.2. This release includes new features providing DevOps teams with clarity, simplicity and additional management capabilities, including an all-new user interface, an interactive graph for visualizing infrastructure code, a new unified agent and broader infrastructure support.
Jul. 28, 2015 12:00 PM EDT
SYS-CON Events announced today that HPM Networks will exhibit at the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. For 20 years, HPM Networks has been integrating technology solutions that solve complex business challenges. HPM Networks has designed solutions for both SMB and enterprise customers throughout the San Francisco Bay Area.
Jul. 28, 2015 11:45 AM EDT Reads: 401
"Alert Logic is a managed security service provider that basically deploys technologies, but we support those technologies with the people and process behind it," stated Stephen Coty, Chief Security Evangelist at Alert Logic, in this SYS-CON.tv interview at 16th Cloud Expo, held June 9-11, 2015, at the Javits Center in New York City.
Jul. 28, 2015 09:45 AM EDT Reads: 272
"We specialize in testing. DevOps is all about continuous delivery and accelerating the delivery pipeline and there is no continuous delivery without testing," noted Marc Hornbeek, Sr. Solutions Architect at Spirent Communications, in this SYS-CON.tv interview at @DevOpsSummit, held June 9-11, 2015, at the Javits Center in New York City.
Jul. 28, 2015 09:30 AM EDT Reads: 342
"ProfitBricks was founded in 2010 and we are the painless cloud - and we are also the Infrastructure as a Service 2.0 company," noted Achim Weiss, Chief Executive Officer and Co-Founder of ProfitBricks, in this SYS-CON.tv interview at 16th Cloud Expo, held June 9-11, 2015, at the Javits Center in New York City.
Jul. 28, 2015 09:15 AM EDT Reads: 1,087
Palerra, the cloud security automation company, announced enhanced support for Amazon AWS, allowing IT security and DevOps teams to automate activity and configuration monitoring, anomaly detection, and orchestrated remediation, thereby meeting compliance mandates within complex infrastructure deployments. "Monitoring and threat detection for AWS is a non-trivial task. While Amazon's flexible environment facilitates successful DevOps implementations, it adds another layer, which can become a target for potential threats. What's more, securing infrastructure and meeting compliance mandates i...
Jul. 27, 2015 10:15 PM EDT Reads: 275
The speed of software changes in growing and large scale rapid-paced DevOps environments presents a challenge for continuous testing. Many organizations struggle to get this right. Practices that work for small scale continuous testing may not be sufficient as the requirements grow. In his session at DevOps Summit, Marc Hornbeek, Sr. Solutions Architect of DevOps continuous test solutions at Spirent Communications, explained the best practices of continuous testing at high scale, which is relevant to small scale DevOps, and if there is an expectation of growth as the number of build targets,...
Jul. 27, 2015 10:00 PM EDT Reads: 1,328
"We got started as search consultants. On the services side of the business we have help organizations save time and save money when they hit issues that everyone more or less hits when their data grows," noted Otis Gospodnetić, Founder of Sematext, in this SYS-CON.tv interview at @DevOpsSummit, held June 9-11, 2015, at the Javits Center in New York City.
Jul. 27, 2015 09:45 PM EDT Reads: 986
Delphix, the market leader in Data as a Service (DaaS), has been announced winner of the DevOps Solution Award at the prestigious Computing Vendor Excellence Awards in London. The awards celebrate the achievements of the technology vendors and service providers that are leading the field of enterprise IT. Delphix was recognised as the vendor demonstrating the most effective support of DevOps culture for its ability to improve time to market and collaboration between teams.
Jul. 27, 2015 08:00 PM EDT Reads: 262
Sysdig has announced two significant milestones in its mission to bring infrastructure and application monitoring to the world of containers and microservices: a $10.7 million Series A funding led by Accel and Bain Capital Ventures (BCV); and the general availability of Sysdig Cloud, the first monitoring, alerting, and troubleshooting platform specializing in container visibility, which is already used by more than 30 enterprise customers. The funding will be used to drive adoption of Sysdig Cloud in the container market.
Jul. 27, 2015 05:00 PM EDT Reads: 409
SYS-CON Events announced today that JFrog, maker of Artifactory, the popular Binary Repository Manager, will exhibit at SYS-CON's @DevOpsSummit Silicon Valley, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Based in California, Israel and France, founded by longtime field-experts, JFrog, creator of Artifactory and Bintray, has provided the market with the first Binary Repository solution and a software distribution social platform.
Jul. 27, 2015 11:00 AM EDT Reads: 1,060
Rapid innovation, changing business landscapes, and new IT demands force businesses to make changes quickly. The DevOps approach is a way to increase business agility through collaboration, communication, and integration across different teams in the IT organization. In his session at DevOps Summit, Chris Van Tuin, Chief Technologist for the Western US at Red Hat, will discuss: The acceleration of application delivery for the business with DevOps
Jul. 27, 2015 10:45 AM EDT Reads: 1,091
Providing the needed data for application development and testing is a huge headache for most organizations. The problems are often the same across companies - speed, quality, cost, and control. Provisioning data can take days or weeks, every time a refresh is required. Using dummy data leads to quality problems. Creating physical copies of large data sets and sending them to distributed teams of developers eats up expensive storage and bandwidth resources. And, all of these copies proliferating the organization can lead to inconsistent masking and exposure of sensitive data. But some organ...
Jul. 26, 2015 05:30 PM EDT Reads: 852
"The new SDKs for Go and Java are yet another addition to our growing support for our DevOps community," said Achim Weiss, Co-founder and CEO of ProfitBricks. "Since the launch of ProfitBricks' DevOps Central, the productivity of the DevOps community remains a top priority for our development team. We've built a strong foundation for our DevOps Central users, and intend on continuing this momentum as the year progresses."
Jul. 26, 2015 10:30 AM EDT Reads: 283
Overgrown applications have given way to modular applications, driven by the need to break larger problems into smaller problems. Similarly large monolithic development processes have been forced to be broken into smaller agile development cycles. Looking at trends in software development, microservices architectures meet the same demands. Additional benefits of microservices architectures are compartmentalization and a limited impact of service failure versus a complete software malfunction. The problem is there are a lot of moving parts in these designs; this makes assuring performance compl...
Jul. 26, 2015 10:00 AM EDT Reads: 1,000
Sumo Logic has announced comprehensive analytics capabilities for organizations embracing DevOps practices, microservices architectures and containers to build applications. As application architectures evolve toward microservices, containers continue to gain traction for providing the ideal environment to build, deploy and operate these applications across distributed systems. The volume and complexity of data generated by these environments make monitoring and troubleshooting an enormous challenge for development and operations teams. The Sumo Logic Collector and Application for Docker now a...
Jul. 26, 2015 08:00 AM EDT Reads: 1,291
Shipping daily, injecting faults, and keeping an extremely high availability "without Ops"? Understand why NoOps does not mean no operations. Agile development methodologies require evolved operations to be successful. In his keynote at DevOps Summit, David Tesar, Microsoft Technical Evangelist on Microsoft Azure and DevOps, will discuss how Microsoft teams who have made huge progress with a DevOps transformation effectively utilize operations staff and how challenges were overcome. Regardless of whether you are a startup or a mature enterprise, whether you are using PaaS, Micro Services, or ...
Jul. 25, 2015 03:00 PM EDT Reads: 2,203
SYS-CON Events announced today that CommVault has been named “Bronze Sponsor” of SYS-CON's 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. A singular vision – a belief in a better way to address current and future data management needs – guides CommVault in the development of Singular Information Management® solutions for high-performance data protection, universal availability and simplified management of data on complex storage networks. CommVault's exclusive single-platform architecture gives companies unp...
Jul. 25, 2015 01:00 PM EDT Reads: 1,933
Electric Cloud and Arynga have announced a product integration partnership that will bring Continuous Delivery solutions to the automotive Internet-of-Things (IoT) market. The joint solution will help automotive manufacturers, OEMs and system integrators adopt DevOps automation and Continuous Delivery practices that reduce software build and release cycle times within the complex and specific parameters of embedded and IoT software systems.
Jul. 25, 2015 12:15 PM EDT Reads: 409
"We provide a service that allows our customers to keep bad guys out and let good guys into their applications running in the public cloud, private cloud or in a classic data center," explained Haseeb Budhani, co-founder and CEO of Soha, in this SYS-CON.tv interview at Cloud Expo, held June 9-11, 2015, at the Javits Center in New York City.
Jul. 25, 2015 12:00 PM EDT Reads: 486
SYS-CON Events announced today that Dyn, the worldwide leader in Internet Performance, will exhibit at SYS-CON's 17th International Cloud Expo®, which will take place on November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Dyn is a cloud-based Internet Performance company. Dyn helps companies monitor, control, and optimize online infrastructure for an exceptional end-user experience. Through a world-class network and unrivaled, objective intelligence into Internet conditions, Dyn ensures traffic gets delivered faster, safer, and more reliably than ever.
Jul. 24, 2015 11:00 PM EDT Reads: 2,042
While DevOps most critically and famously fosters collaboration, communication, and integration through cultural change, culture is more of an output than an input. In order to actively drive cultural evolution, organizations must make substantial organizational and process changes, and adopt new technologies, to encourage a DevOps culture. Moderated by Andi Mann, panelists discussed how to balance these three pillars of DevOps, where to focus attention (and resources), where organizations might slip up with the wrong focus, how to manage change and risk in all three areas, what is possible a...
Jul. 24, 2015 09:15 PM EDT Reads: 1,927