News

By: Charles Romine Artificial Intelligence (AI) promises to grow the economy and improve our lives, but with these benefits, it also brings new risks that society is grappling with. How can we be sure this new technology is not just innovative and helpful, but also trustworthy, unbiased, and resilient in the face of attack? We sat down with NIST Information Technology Lab Director Chuck Romine to learn how measurement science can help provide answers. How would you define artificial intelligence? How is it different from regular computing? One of the challenges with defining artificial intelligence is that if you put 10 people in a room, you get 11 different definitions. It's a moving target. We haven't converged yet on exactly what the definition is, but I think NIST can play an important role here. What we can't do, and what we never do, is go off in a room and think deep thoughts and say we have the definition. We engage the community. That said, we're using a narrow working definition specifically for the satisfaction of the Executive Order on Maintaining American Leadership in Artificial Intelligence, which makes us responsible for providing guidance to the federal government on how it should engage in the standards arena for AI. We acknowledge that there are multiple definitions out there, but from our perspective, an AI system is one that exhibits reasoning and performs some sort of automated decision-making without the interference of a human. There's a lot of talk at NIST about “trustworthy” AI. What is trustworthy AI? Why do we need AI systems to be trustworthy? AI systems will need to exhibit characteristics like resilience, security and privacy if they're going to be useful and people can adopt them without fear. That's what we mean by trustworthy. Our aim is to help ensure these desirable characteristics. We want systems that are capable of either combating cybersecurity attacks, or, perhaps more importantly, at least recognizing when they are being attacked. We need to protect people's privacy. If systems are going to operate in life-or-death type of environments, whether it's in medicine or transportation, people need to be able to trust AI will make the right decisions and not jeopardize their health or well-being. Resilience is important. An artificial intelligence system needs to be able to fail gracefully. For example, let's say you train an artificial intelligence system to operate in a certain environment. Well, what if the system is taken out of its comfort zone, so to speak? One very real possibility is catastrophic failure. That's clearly not desirable, especially if you have the AI deployed in systems that operate critical infrastructure or our transportation systems. So, if the AI is outside of the boundaries of its nominal operating environment, can it fail in such a way that it doesn't cause a disaster, and can it recover from that in a way that allows it to continue to operate? These are the characteristics that we're looking for in a trustworthy artificial intelligence system. NIST is supposed to be helping industry before they even know they needed us to. What are we thinking about in this area that is beyond the present state of development of AI? Industry has a remarkable ability to innovate and to provide new capabilities that people don't even realize that they need or want. And they're doing that now in the AI consumer space. What they don't often do is to combine that push to market with deep thought about how to measure characteristics that are going to be important in the future. And we're talking about, again, privacy, security and resilience ... trustworthiness. Those things are critically important, but many companies that are developing and marketing new AI capabilities and products may not have taken those characteristics into consideration. Ultimately, I think there's a risk of a consumer backlash where people may start saying these things are too easy to compromise and they're betraying too much of my personal information, so get them out of my house. What we can do to help, and the reason that we've prioritized trustworthy AI, is we can provide that foundational work that people in the consumer space need to manage those risks overall. And I think that the drumbeat for that will get increasingly louder as AI systems begin to be marketed for more than entertainment. Especially at the point when they start to operate critical infrastructure, we're going to need a little more assurance. That's where NIST can come together with industry to think about those things, and we've already had some conversations with industry about what trustworthy AI means and how we can get there. I'm often asked, how is it even possible to influence a trillion-dollar, multitrillion-dollar industry on a budget of $150 million? And the answer is, if we were sitting in our offices doing our own work independent of industry, we would never be able to. But that's not what we do. We can work in partnership with industry, and we do that routinely. And they trust us, they're thrilled when we show up, and they're eager to work with us. AI is a scary idea for some people. They've seen “I, Robot,” or “The Matrix,” or “The Terminator.” What would you say to help them allay these fears? I think some of this has been overhyped. At the same time, I think it's important to acknowledge that risks are there, and that they can be pretty high if they're not managed ahead of time. For the foreseeable future, however, these systems are going to be too fragile and too dependent on us to worry about them taking over. I think the biggest revolution is not AI taking over, but AI augmenting human intelligence. We're seeing examples of that now, for instance, in the area of face recognition. The algorithms for face recognition have improved at an astonishing rate over the last seven years. We're now at the point where, under controlled circumstances, the best artificial intelligence algorithms perform on par with the best human face recognizers. A fascinating thing we learned recently, and published in a report, is that if you take two trained human face recognizers and put them together, the dual system doesn't perform appreciably better than either one of them alone. If you take two top-performing algorithms, the combination of the two doesn't really perform much better than either one of them alone. But if you put the best algorithm together with a trained recognizer, that system performs substantially better than either one of them alone. So, I think, human augmentation by AI is going to be the revolution. What's next? I think one of the things that is going to be necessary for us is pulling out the desirable characteristics like usability, interoperability, resilience, security, privacy and all the things that will require a certain amount of care to build into the systems, and get innovators to start incorporating them. Guidance and standards can help to do that. Last year, we published our plan for how the federal government should engage in the AI standards development process. I think there's general agreement that guidance will be needed for interoperability, security, reliability, robustness, these characteristics that we want AI systems to exhibit if they're going to be trusted. https://www.nist.gov/blogs/taking-measure/trustworthy-ai-conversation-nists-chuck-romine

by Chris Thatcher; Skies Magazine Posted on December 24, 2019 When the Aerospace Industries Association of Canada in June released its blueprint for the next five years, Vision 2025: Charting a New Course, support for small- and medium-sized enterprises (SMEs) was one of its core themes. Small companies make up over 90 per cent of the sector and the report argued for greater government support to help them scale up, generate more jobs, and enhance their global competitiveness. That could include new funding to pursue digital business transformation, a reduction in the complexity of government contracting, and greater priority in the value propositions of prime contractors chasing defence procurements. “If our small- and mid-sized companies are left at risk, the negative impacts will be felt across Canada's aerospace industry as a whole,” according to the report, prepared by Jean Charest, a former premier of Quebec and deputy prime minister of Canada. Small companies are viewed as the prime creators of aerospace jobs and, in a sector buffeted by changing technology and new players, many may be more agile and better able to adapt than larger counterparts that must answer to corporate headquarters outside of Canada. But support from original equipment manufacturers (OEMs) and governments is essential to their survival, according to a panel of SMEs at the Canadian Aerospace Summit in November. There is no one-size-fits-all to helping SMEs scale up. Companies at different stages of growth require different types of support, they noted. But help with skilled labour shortages and easier access to government programs are common challenges for all. A solid position on a major platform is critical to initial success, but long-term growth requires diversification, observed Barney Bangs, chief executive officer of Tulmar Safety Systems. Located between Ottawa and Montreal in the small community of Hawkesbury, Ont., the company manufactures protective and safety equipment, associated components and in-flight training products. Traditionally, its focus has been 80 per cent defence — Tulmar has been a supplier to a military platform for over 25 years and benefitted from a strong aftermarket. In recent years, though, the company has sought a better balance between military and commercial customers. “As of last year, we were 65 per cent defence and 35 per cent (civilian) aerospace,” he said. Tulmar has also become more of what he called “a solution provider,” integrating components from other suppliers to provide an OEM with a final, certified piece of equipment such as an aircraft seat rather than just the safety harness or seatbelt. “We are doing more in-house and saving customer-costs for the OEM,” said Bangs. Diversification has also been a priority for Apex Industries, a machining, components, subassembly and structures manufacturer in Moncton, N.B. Twelve years ago, its aerospace business was five per cent defence and 95 per cent civil, much of it geared to Bell Helicopter and Bombardier. “We made a conscious effort to diversify into the military side a lot more,” said vice-president Keith Donaldson. “We are very conscious of not allowing our sales to go too high on one platform or with one customer.” Challenged by cost-savings pressures in commercial aviation contracts, military platforms offer a company like APEX “good visibility,” he said. However, militaries have long been trading quantity for technological superiority, meaning fewer platforms and a relatively short production cycle. And ramping up quickly with people and equipment to meet tight delivery schedules is a challenge for small businesses that need other options to justify and sustain the investment when the contract ends. “It is very tough for a SME like ourselves to invest.” However, defence procurement and government programs can go a long way to supporting the scale-up of SMEs, said Patrick Mann, president of Patlon Aircraft & Industries, a technical sales force for global manufacturers of custom components and systems. The scale-up program must be run by single entity within government committed to the Canadian SME community that would be “funded, independent and have the authority to make decisions.” Mann suggested coping what has worked well in other jurisdictions, noting the success of the United States Small Business Administration's set-aside program. “Within that, there is a small business innovation research program which has been highly successful in scaling up SMEs,” he said. The Vision 2025 report called for a federal scale-up program to “provide advice, coaching, networking, value proposition development and consortium-building support to incentivize growth and build capacity–helping firms expand their global footprints and giving them the means and maturity to support OEMs effectively.” The report recommended the Office of Small and Medium Enterprises (OSME) within Public Services and Procurement Canada shoulder that responsibility. “Having OSME at the table as a contributor to the development of government procurement strategies and as a champion of small and medium-sized business interests will help ensure government policies and programs recognize the unique characteristics of small firms,” it stated. “We are a pretty good example of a scale-up of an SME using competitive bid government procurement as a mechanism,” said Mann. However, developments over the past 10 years such as single point of accountability and bundling, where multiple small contracts are combined in one larger procurement that is awarded to one contractor, have been “devasting” to smaller suppliers. “It has been a real issue for us. Again, it is an issue where (OSME) can play a role.” OEMs can bolster government programs by mentoring small companies within their supplier base on management and production processes, especially around digitization, added Donaldson. “OEMs have a lot of that knowledge ... [but] I don't think [they] do enough of that.” He and Bangs both cautioned that the ability to scale up will be contingent on resolving talent shortages. Developing and attracting skilled labour is a chronic problem affecting the entire sector, but it is particularly acute for SMEs in more remote locations that don't have the resources to recruit as widely or navigate the immigration system. “Before we launch a scale-up program with support for financing and working capital, we have to make sure we have our skills done first,” said Donaldson. However the Liberal government opts to respond to the Vision 2025 report, the value of investing in SMEs should be clear. Viking Air, KF Aerospace or IMP Aerospace & Defence were once small companies and are “now thriving global participants,” said Mann. “That is the reason why todays SMEs are an important part of our industry.”

The Army is looking for new technology that can be in the hands of Soldiers by 2023. So we're inviting companies to share their ideas for the chance to "pitch" us during Innovation Days in Austin and earn a new Army contract. To be considered, submit your concept through our online portal, which guides you through the required information in a Turbo Tax® style. You can find more information on what to include in this quick overview or via the announcement. You may not know all of the answers, and that's ok. The more technical details, visuals, and vision you can share to illustrate your technology, the better we'll be able to assess it against the Army's needs. The deadline to submit concepts for this event is 4:00pm ET on December 20, 2019. We can't wait to see what you've got! https://aal.army/innovationdays/