Search

Search Results

• 1. [Article] Risk-Based Monitoring: A Model and Application to FDA’s Imported Food Monitoring Program

  Regulatory agencies intervene in risky situations by outlawing practices that impose risks on society or by proscribing practices that reduce risk. Because public resources for enforcing regulation are ...

  Citation × Citation Citation Abstract Copy Title: Risk-Based Monitoring: A Model and Application to FDA’s Imported Food Monitoring Program Author: Martin, Sheila A., Beaulieu, Nancy Dean, Williams, Richard Year: 1999 Regulatory agencies intervene in risky situations by outlawing practices that impose risks on society or by proscribing practices that reduce risk. Because public resources for enforcing regulation are limited, public policy has recently emphasized maximizing the benefit from enforcement by considering the risk reduction achievable from each intervention. This emphasis requires a shift of resources to monitoring situations in which regulatory violations are most likely, their welfare effects are most serious, and their detection is probable and relatively inexpensive. This article is a risk-based monitoring model applied to the Food and Drug Administration's (FDA) import monitoring program. Although some components of the model are specific to FDA's data and regulatory needs, this model's basic structure is applicable to many situations in which a decisionmaker seeks to identify the most cost-effective choices for reducing risk. Title: Risk-Based Monitoring: A Model and Application to FDA’s Imported Food Monitoring Program Author: Martin, Sheila A., Beaulieu, Nancy Dean, Williams, Richard Year: 1999 Regulatory agencies intervene in risky situations by outlawing practices that impose risks on society or by proscribing practices that reduce risk. Because public resources for enforcing regulation are limited, public policy has recently emphasized maximizing the benefit from enforcement by considering the risk reduction achievable from each intervention. This emphasis requires a shift of resources to monitoring situations in which regulatory violations are most likely, their welfare effects are most serious, and their detection is probable and relatively inexpensive. This article is a risk-based monitoring model applied to the Food and Drug Administration's (FDA) import monitoring program. Although some components of the model are specific to FDA's data and regulatory needs, this model's basic structure is applicable to many situations in which a decisionmaker seeks to identify the most cost-effective choices for reducing risk. Close

• 2. [Article] Traditional and Nontraditional Data as Indicators of Economic Activity in Rural Communities

  The objective of this study was twofold: (1) to identify nontraditional sources of data that can be used to monitor economic activity in rural areas, and (2) to test the relationship between such data ...

  Citation × Citation Citation Abstract Copy Title: Traditional and Nontraditional Data as Indicators of Economic Activity in Rural Communities Author: McHugh, Richard, Cooper, Ronald, Martin, Sheila A., Otto, Daniel, Johnson, Stanley R. Year: 1990 The objective of this study was twofold: (1) to identify nontraditional sources of data that can be used to monitor economic activity in rural areas, and (2) to test the relationship between such data and trends in traditional measures, such as income and employment. The need for alternative sources of data arises primarily out of the inconsistent quality and availability of traditional economic data at the subs tate level. New sources of data can help reduce this metro-rural data gap and provide a fuller picture of the diverse experience and structure of subs tate economies. Two sources of nontraditional data were explored: state government administrative records, and data from local private and quasi-private companies, such as utilities and banks. In particular, banking data from the Federal Reserve Bank of Chicago, phone connection data from Northwest Bell (U.S. West), and food stamp program data were used. The data series consisted of county-level data for Iowa, Minnesota, and Wisconsin. These data were statistically compared to employment growth levels in each county. Banking data (reflecting bank Willingness and ability to lend), phone data (reflecting new household and business formations), and food stamp participation correlated significantly (though weakly) with growth. The weak correlations are expected because the nontraditional data series are generally more volatile, or erratic, than employment data series. Composite indexes were constructed from the data and correlated with the employment data series. The results showed improved correlations and suggest that such indexes may be useful as leading indicators of economic activity. Overall, the results show that there is considerable potential in the development of economic indicators from nontraditional data. Title: Traditional and Nontraditional Data as Indicators of Economic Activity in Rural Communities Author: McHugh, Richard, Cooper, Ronald, Martin, Sheila A., Otto, Daniel, Johnson, Stanley R. Year: 1990 The objective of this study was twofold: (1) to identify nontraditional sources of data that can be used to monitor economic activity in rural areas, and (2) to test the relationship between such data and trends in traditional measures, such as income and employment. The need for alternative sources of data arises primarily out of the inconsistent quality and availability of traditional economic data at the subs tate level. New sources of data can help reduce this metro-rural data gap and provide a fuller picture of the diverse experience and structure of subs tate economies. Two sources of nontraditional data were explored: state government administrative records, and data from local private and quasi-private companies, such as utilities and banks. In particular, banking data from the Federal Reserve Bank of Chicago, phone connection data from Northwest Bell (U.S. West), and food stamp program data were used. The data series consisted of county-level data for Iowa, Minnesota, and Wisconsin. These data were statistically compared to employment growth levels in each county. Banking data (reflecting bank Willingness and ability to lend), phone data (reflecting new household and business formations), and food stamp participation correlated significantly (though weakly) with growth. The weak correlations are expected because the nontraditional data series are generally more volatile, or erratic, than employment data series. Composite indexes were constructed from the data and correlated with the employment data series. The results showed improved correlations and suggest that such indexes may be useful as leading indicators of economic activity. Overall, the results show that there is considerable potential in the development of economic indicators from nontraditional data. Close

• 3. [Article] Output-Based Performance Measures for the North Carolina Office of Waste Reduction

  Research Triangle Institute (RTI) conducted this study to provide the foundation for implementing a results-based performance measurement system. RTI designed a system for NC OWR and similar state waste ...

  Citation × Citation Citation Abstract Copy Title: Output-Based Performance Measures for the North Carolina Office of Waste Reduction Author: Martin, Sheila A., Youngberg, James R., Bethke, Albert D. Year: 1996 Research Triangle Institute (RTI) conducted this study to provide the foundation for implementing a results-based performance measurement system. RTI designed a system for NC OWR and similar state waste reduction outreach programs in EPA’s Region 4 that will collect, analyze, report, and maintain the output-based performance measures needed to manage the system, to monitor program scope and effectiveness, and to report to managers and key stakeholders on the program’s success in accomplishing its 0bjectives. Key questions we have addressed in this study include the following: What is the current best practice for collecting and analyzing information about the effectiveness of waste reduction and pollution prevention technology deployment? Who are the key users of the evaluation system? What are their information needs? What are the key sources of information for the evaluation system? What information do they provide? Given the sources and uses of data, what are the key variables for the system? Which variables already exist, and which need to be defined and constructed? At what levels are they measured and over what time frames? What methods should be employed to convert raw data into usable information, including performance metrics? How will database users access the system? This report summarizes the study and describes the database system that we developed to assist the NC OWR and other waste reduction offices in Region 4 in tracking and evaluating their efforts. Title: Output-Based Performance Measures for the North Carolina Office of Waste Reduction Author: Martin, Sheila A., Youngberg, James R., Bethke, Albert D. Year: 1996 Research Triangle Institute (RTI) conducted this study to provide the foundation for implementing a results-based performance measurement system. RTI designed a system for NC OWR and similar state waste reduction outreach programs in EPA’s Region 4 that will collect, analyze, report, and maintain the output-based performance measures needed to manage the system, to monitor program scope and effectiveness, and to report to managers and key stakeholders on the program’s success in accomplishing its 0bjectives. Key questions we have addressed in this study include the following: What is the current best practice for collecting and analyzing information about the effectiveness of waste reduction and pollution prevention technology deployment? Who are the key users of the evaluation system? What are their information needs? What are the key sources of information for the evaluation system? What information do they provide? Given the sources and uses of data, what are the key variables for the system? Which variables already exist, and which need to be defined and constructed? At what levels are they measured and over what time frames? What methods should be employed to convert raw data into usable information, including performance metrics? How will database users access the system? This report summarizes the study and describes the database system that we developed to assist the NC OWR and other waste reduction offices in Region 4 in tracking and evaluating their efforts. Close

• 4. [Article] Output-Based Performance Measures for the North Carolina Alliance for Competitive Technologies

  The North Carolina Alliance for Competitive Technologies (NC ACTs) is an organization operated by the state of North Carolina to coordinate technology development and, deployment activities in the state. ...

  Citation × Citation Citation Abstract Copy Title: Output-Based Performance Measures for the North Carolina Alliance for Competitive Technologies Author: Martin, Sheila A. Year: 1994 The North Carolina Alliance for Competitive Technologies (NC ACTs) is an organization operated by the state of North Carolina to coordinate technology development and, deployment activities in the state. The mission of NC ACTs is to apply innovation, technology, and technical resources to promote economic growth in the state. NC ACTs will operate as a central, strategic organization to guide existing resources and to develop new resources when necessary. To accomplish its mission, NC ACTs must coordinate institutions and organizations that currently offer technology development and deployment into a rational, customer-driven system that measures and rewards results. Timely, reliable assessment and evaluative feedback will be essential to managing these programs effectively. A well-designed system for performance assessment and evaluation can fill a number of management needs (Shapira, Youtie, and Roessner, 1994): Monitoring the progress of NC ACTs and its components in accomplishing their missions; Measuring and improving customer satisfaction; Identifying the most promising strategies and understanding why they are effective; Rewarding and reinforcing positive results; Allocating resources to their most effective uses; and Demonstrating accountability and value to program sponsors. The design of an evaluation plan is critical in public institutions. While sponsors of public programs demand measures of performance and effectiveness, typical market indicators of success (i.e., market share, profit, stock price) are not applicable. Therefore, the evaluation plan must use credible techniques, reliable data, and consistent methodologies without draining organizational resources. To meet these standards, an evaluation plan must be developed during the genesis of the organization. Early assessment allows program managers to adopt the evaluation system as part of the overall management strategy and provides data for program assessment at critical early stages of operation. For this reason, NC ACTs has designed an output-based performance measurement system as part of the NC ACTs operating plan for its first year. The remainder of this paper discusses our plans for measuring the effectiveness of NC ACTs. Some features of the evaluation design are typical of the data collection efforts being conducted by many of the Manufacturing Technology Centers (MTC’s) and Manufacturing Outreach Centers (MOC’s). However, due to the unique design and mission of NC ACTs, we have deviated somewhat from the usual set of performance metrics for technology deployment organizations. This paper focuses on two of those features: measuring organizational influence and measuring technological influence. The second section contains a discussion of the overall design of the data collection, analysis, and reporting system being planned for NC ACTs. The third section focuses on how NC ACTs will measure its influence on the quality and direction of the technology services available in the state of North Carolina. The fourth section discusses a strategy for analyzing the influence of NC ACTs on the use of efficient core technologies emphasizing environmental technologies. The final section contains a summary. Title: Output-Based Performance Measures for the North Carolina Alliance for Competitive Technologies Author: Martin, Sheila A. Year: 1994 The North Carolina Alliance for Competitive Technologies (NC ACTs) is an organization operated by the state of North Carolina to coordinate technology development and, deployment activities in the state. The mission of NC ACTs is to apply innovation, technology, and technical resources to promote economic growth in the state. NC ACTs will operate as a central, strategic organization to guide existing resources and to develop new resources when necessary. To accomplish its mission, NC ACTs must coordinate institutions and organizations that currently offer technology development and deployment into a rational, customer-driven system that measures and rewards results. Timely, reliable assessment and evaluative feedback will be essential to managing these programs effectively. A well-designed system for performance assessment and evaluation can fill a number of management needs (Shapira, Youtie, and Roessner, 1994): Monitoring the progress of NC ACTs and its components in accomplishing their missions; Measuring and improving customer satisfaction; Identifying the most promising strategies and understanding why they are effective; Rewarding and reinforcing positive results; Allocating resources to their most effective uses; and Demonstrating accountability and value to program sponsors. The design of an evaluation plan is critical in public institutions. While sponsors of public programs demand measures of performance and effectiveness, typical market indicators of success (i.e., market share, profit, stock price) are not applicable. Therefore, the evaluation plan must use credible techniques, reliable data, and consistent methodologies without draining organizational resources. To meet these standards, an evaluation plan must be developed during the genesis of the organization. Early assessment allows program managers to adopt the evaluation system as part of the overall management strategy and provides data for program assessment at critical early stages of operation. For this reason, NC ACTs has designed an output-based performance measurement system as part of the NC ACTs operating plan for its first year. The remainder of this paper discusses our plans for measuring the effectiveness of NC ACTs. Some features of the evaluation design are typical of the data collection efforts being conducted by many of the Manufacturing Technology Centers (MTC’s) and Manufacturing Outreach Centers (MOC’s). However, due to the unique design and mission of NC ACTs, we have deviated somewhat from the usual set of performance metrics for technology deployment organizations. This paper focuses on two of those features: measuring organizational influence and measuring technological influence. The second section contains a discussion of the overall design of the data collection, analysis, and reporting system being planned for NC ACTs. The third section focuses on how NC ACTs will measure its influence on the quality and direction of the technology services available in the state of North Carolina. The fourth section discusses a strategy for analyzing the influence of NC ACTs on the use of efficient core technologies emphasizing environmental technologies. The final section contains a summary. Close