Mare Forum 2000: The Shipping Risk Management Forum      

QUALITY MANAGEMENT versus RISK FINANCE IN SHIPPING

25 & 26 September 2000, Athens Greece

 

Mr. Ioannis Kourmatzis, Vice-President

Det Norske Veritas

 

 

Formal  Safety Assessment (FSA): A Modern Foundation  for Marine Safety

 Ioannis Kourmatzis*, John Spouge* and Rune Torhaug*

 

 

ABSTRACT

Formal Safety Assessment (FSA) is a structured and systematic methodology, aimed at enhancing maritime safety by using risk and cost-benefit assessments in the rule development process.  An interim guideline for the application of FSA to the International Maritime Organisation (IMO) rule-making process was agreed in 1997

Det Norske Veritas (DNV) believes that risk technology may drive  the shipping industry to  a deeper understanding of marine safety.  In this paper we describe how we can  utilise the FSA methodology  to  enhance the quality of the rule making process and thus achieve better and more cost efficient Rules.  We also discuss how we take advantage of the FSA process to ensure that classification rules and survey schemes become  transparent and focused on the essential aspects with respect to safety and  environment, without unnecessary business interruptions for the ship owner.  Finally, we focus on overall safety philosophy and acceptance criteria for FSA based Rules  and we give  practical examples on how overall  safety philosophy can be linked to concrete prescriptive regulations.

 

 

 

Key Words: Formal Safety Assessment, Rule Development, Classification Societies

 


Introduction

The Current Marine Safety Regime

Safety in ships is to a large extent achieved by following rules, regulations or guidelines governing their design and operation.  The rules most directly concerned with human safety and protection of the environment are in general agreed internationally through the IMO.  Rules for the structural strength, systems and equipment required to make the ship “fit for purpose” are mainly established by independent Classification Societies.  On safety-critical structural issues, the International Association of Classification Societies (IACS) provides common international standards.  These rules have been developed incrementally over many decades, responding to accident experience, and represent a massive accumulation of expertise in how to allow designers as much freedom as possible while still achieving a good common level of safety.

While safety levels at sea have in general improved in recent years, accidents still occur, and some problems have become apparent with the current marine safety regime. The system of international rule making is to a large extent reactive, responding to accidents rather than proactively preventing them. It is vulnerable to rapid changes in ship designs, which may introduce hazards not anticipated in the rules. The rules, even when comprehensive, are not sufficiently transparent, and the purpose and relevance of individual rules is often unclear. The process of developing the rules was insufficiently systematic, with no method of prioritising on the areas where the greatest benefit could be achieved.

 

The Origins of FSA

Several major shipping accidents (notably the Herald of Free Enterprise in 1987 and the Exxon Valdez in 1989) prompted a re-evaluation of the marine safety regime. It was contrasted unfavourably with that used in other industries, based on more scientific safety management approaches such as risk analysis and safety cases [2].

“Safety Cases” identify the hazards faced by an individual ship and explain the safety management measures adopted, in order to convince regulators, the workforce or the public that the individual ship is safe. This approach is suitable for some types of vessels, particularly those with unusual hazards, operating within specific regions [3]. However, the varying ability to follow modern safety management principles among shipping companies and maritime administrations is widely believed to make Safety Cases inappropriate for internationally trading ships.

Instead of a safety case for each individual ship, the UK proposed that “formal safety assessment” (FSA) should be used to provide a more systematic and proactive basis for the IMO rule-making process. FSA included techniques of safety assessment, such as hazard identification, risk analysis and cost-benefit analysis, which were already being adopted by organisations in the marine field, and this helped the approach gain international acceptance. In 1997, IMO adopted guidelines for applying FSA [1] and has since been evaluating trial applications of the technique.

 

DNV’s Adoption of FSA

Det Norske Veritas has been at the forefront of applying scientific approaches to developing its classification rules, and was an early supporter of the FSA initiative [4]. DNV recognises that FSA has the potential to improve the transparency of its rules, and to help focus on the essential factors protecting safety, property and the environment.

In 1998, building on previous initiatives, DNV initiated a dedicated research project to develop a transparent and sound scientific basis for its Ship Classification Rules and Procedures, and decided to use the FSA approach, consistent as far as possible with the approach adopted by IMO.

 

Objectives of This Paper

This paper gives an overview of DNV’s FSA-based ship rule development project. Section 2 explains the philosophy underlying the work and the general approach adopted. Section 3 gives an example to illustrate how it will work in practice. Section 4 discusses some of the lessons learned to date and the road ahead. Section 5 makes conclusions about the impact of FSA on the rule-making process.

 

DNV’s ApprOAch to FSA

FSA at IMO

IMO (1997) defined FSA as a 5-step process, consisting of:

1.             Hazard identification

2.             Risk assessment

3.             Risk control options

4.             Cost-benefit assessment

Recommendations for decision-making

 

The purposes of the FSA are to identify areas of concern in the existing regulations, to set priorities for new regulations, or to analyse the implications of proposed amendments. The FSA is applied to generic ships or systems, characteristic of the type affected by the regulations under consideration. Step 1 involves identifying relevant hazards, and Step 2 requires a quantitative estimation of the resulting risks for people, property and the environment. Step 3 considers various options for managing the risks (i.e. through new regulations), and estimates their benefits in reducing the risks. Step 4 compares these benefits with the costs of implementing the option for all stakeholders. Step 5 recommends to decision-makers which regulatory options should be adopted to make the risks as low as reasonably practicable.

 

DNV’s Philosophy for FSA

Using FSA for improving classification rules is fundamentally no different to using it for IMO regulations. Class Societies are able to make decisions rather more swiftly than IMO, but is still constrained by the need to reach agreement with IACS in many areas, and by the essential need to retain the support of shipowners. For DNV this provides an incentive to align itself closely with the international approach to FSA, and to contribute positively to developments at IMO and IACS. 


Being a single organisation, DNV may take advantage of a more consistent approach to FSA than is realistically possible among the many governments and organisations that contribute to IMO. This is why DNV decided to develop a common foundation for all its FSA work, which will allow different units to apply FSA to different rule topics while making consistent assumptions about overall risk levels.

The scope of services from classification societies is wider than IMO’s remit, since class rules are intended to ensure that the ship is fit for purpose, as well as safe. This provides some degree of protection against interruptions of the owner’s business, and is in general provided by rules for voluntary class notations. This makes it important for DNV’s FSA to distinguish clearly between rules that are required to achieve safety of life and the environment, and those that help protect the owner’s assets and optimise business efficiency, which should be optional provided that fundamental safety goals are met.

 

DNV’s Foundation for FSA-Based Rule Development

A comprehensive FSA of all class rules is a massive undertaking. The rules have evolved over many years, incorporating immense practical experience, but there is little documented evidence on which hazards they address and how effective they are. Most rule sections can apply to any type of ship, so that their costs and benefits will differ in different applications. Underlying the formal rulebook are various survey schemes, customary interpretations and supplementary guidance, so that rules can not always be interpreted in isolation. The rules are intended to function as a coherent whole, and cannot always be readily broken down into independent units for analysis.

While an FSA of class rules could be done in an informal qualitative way, giving rules that are loosely “risk-based”, establishing a fully transparent risk basis for the rules requires a more rigorous approach. DNV therefore decided to quantify the costs and benefits of its rules, as far as possible, consistent with the 5-step FSA methodology. Completing this will take many years and involve contributions from each of various discipline units involved in rule development. To achieve consistency within such an undertaking, a firm supporting foundation is required.

DNV’s foundation for FSA based ship rule development will include:

Outline risk estimates for all major generic ship types.

Detailed FSAs of key generic ship types (tanker, bulk carrier, container ship etc)

A “rule map” showing the purpose of each section of the DNV Rules

Acceptance criteria defining whether particular aspects of ships satisfy the Rules

Pilot Rule FSAs of selected rule topics, identifying cost-effective rule amendments

An FSA guideline, explaining how FSA will be used in the rule development process

 

The combination of generic ship FSAs and the rule map will form an “FSA Platform”, supplying the essential information needed for an FSA of any given rule topic. The actual FSAs of rule topics will be an ongoing part of rule development, but the current project will illustrate how this will work by means of a few pilot rule FSAs. Our long-term vision is that a full set of rule FSAs for each rule topic area will complete the FSA of the DNV Rules (Figure 1).

 

 

Development of the foundation provides many benefits for DNV and its customers, in addition to establishing the platform for efficient rule FSAs:

The FSAs of generic ships provide the basis for prioritising future rule development. By showing the sources of risk, they allow rational top-down allocation of resources for rule development, instead of the current rather arbitrary competition for resources between rule development projects.

The rule map is a valuable contribution to achieving transparency in the rules. By using a simple qualitative review technique, based on risk principles, the motivation behind each rule can be documented, revealing its relevance to particular ship types.

The hazard identification element in the FSAs encapsulates the proactive aspect of rule development under the FSA approach. Through the use of systematic, team-based techniques, it enables hazards to be identified and risk control options proposed, before they result in accidents.

DNV’s internal FSA guideline will help solve the problem of achieving consistency in the use of FSA within a large organisation.

 

Acceptance Criteria for FSA-Based Ship Rules

DNV’s corporate objective is to safeguard life, property and the environment. Therefore, the fundamental objective of DNV’s rules is ensuring that ships have an acceptable level of safety in respect of life, property and the environment. What is meant by “acceptable level of safety” is defined by risk acceptance criteria.

Risk acceptance criteria are the standards that define whether the risks estimated to arise on the ship are acceptable. In other words, they answer questions such as “How safe is safe enough?” or “What is a reasonably practicable risk control option?” In deciding what is acceptable (and to whom) DNV takes account of not only of the interests of ship owners, but also of its wider social role in protecting the public and the environment.

DNV is in the process of developing risk acceptance criteria for its ship rules, and the following should be regarded as proposals that need further evaluation and may be revised in due course. Such acceptance criteria need to be discussed within the industry and over time need to form the basis for a set of common criteria widely accepted by regulators in the maritime area.

DNV’s main mandatory class notation is +1A1, intended to ensure that all ships meet a basic common standard of safety. DNV consider an acceptable level of safety for +1A1 Class will require that:

Individual risks of death for crew, passenger and members of the public shall meet defined acceptance criteria (Table 1). For example, the individual risk to crew members shall not exceed 10-3 per year, i.e. a 1 in 1000 chance per year of death in an accident on the ship. These are based on acceptance criteria that are widely used in several industries [5].


In addition, risks shall be made “as low as reasonably practicable” (ALARP) by adopting cost-effective measures protecting life, third-party property and the environment. This includes any measures that give a positive net benefit in reducing costs of damage, if risk to life is excluded. Alternatively, it includes any measures whose implied cost per averted fatality (ICAF) is less than US $3 million. These are based on values used for decision-making in a recent trial application of FSA at IMO [6].

 


Table 1 Individual Risk Acceptance Criteria

Maximum tolerable risk for crew members

10-3 per person year

Maximum tolerable risk for passengers

10-4 per person year

Maximum tolerable risk for public ashore

10-4 per person year

Negligible risk

10-6 per person year

 

These acceptance criteria for +1A1 Class do not take account of any benefit that rules may have in protecting the ship itself, except where this also helps protect life or prevent environmental damage. Rules that protect the ship itself from damage or delay will be covered by different acceptance criteria for voluntary class notations. Voluntary class notations are assigned to vessels with specific operational or trade characteristics and may give more exacting standards of human safety and environmental protection, suitable for owners who wish to demonstrate performance in these areas considerably above the world-wide minimum.

 

Example Results

Generic Ship FSAs

 
The first requirement in applying the above approach is to establish the baseline risks on different types of ship, and show whether they meet the individual risk acceptance criteria. Figure 2 shows the results of DNV’s analysis of individual risks for crew on selected generic ship types, expressed in terms of the annual risk of death for average crew members. It shows that all types meet the proposed criteria, and lie in the ALARP range. This important conclusion helps justify the surprising lack of emphasis on risk acceptance criteria in the IMO guideline, because it shows that the cost-benefit evaluation of risk control options is the most important factor determining the overall acceptability of risks.

In order to show the benefits of risk reduction options, it is necessary to establish the breakdown of the observed risks, and to convert them into monetary units. Figure 3 shows the results of DNV’s analysis of the total risks on oil tankers, expressed in terms of the average annual cost of accidents. This figure includes costs of accident to the ship, as well as to people, other property and the environment, but these components can readily be separated for the cost-benefit analysis of individual rules.

 

 

Rule FSA for Flap Rudders

DNV’s first pilot application of the FSA approach to rule development was for flap rudders. At present there are no rules that explicitly address flap rudders, and class rules are based on conventional rudders without flaps.

Figure 1

 
A hazard identification exercise (FSA Step 1) was carried out to identify potential failure in flap rudders and recommend possible risk control measures. The exercise used a multi-disciplinary team and followed a modified HAZOP (hazard and operability study) methodology. A gap analysis was then used to compare the recommendations with DNV’s existing rules, regulations and survey procedures, and hence to develop practical risk control options (RCOs) as shown in Table 2 (FSA Step 3).

 

Table 2 Risk Control Options for Flap Rudders

1.

Use similar material requirements for flap components as for conventional rudders

2.

Develop procedure for design approval of flap rudders

3.

Monitoring/indication of flap rudder angle

4.

Measuring of clearances at each bottom survey

5.

Regular inspection of pivot link and upper hinge

6.

Planned maintenance of bearings/hinges/pivot

7.

Develop specific survey guidance for flap rudders

 


The risk analysis of the flap rudder (FSA Step 2) was based on the generic oil tanker FSA, and used the results in Figure 3 to show that the average annual cost of failures of conventional rudders on oil tankers was $820 per ship year. This was dominated by delays and repair costs, since the costs to people and the environment resulting from groundings consequent on rudder failures were only $20 per ship year. These are based on theoretical predictions using an event tree technique, since no such events had occurred in the period selected for analysis. Based on DNV’s failure data, the risks for flap rudders were estimated to be 3 times higher than for conventional rudders, giving a total cost of rudder failures of $2500 per ship year for a tanker with a flap rudder. This is the maximum possible benefit of any additional risk control option, and places a useful upper limit on the cost impact of further rules.

A cost-benefit analysis was carried out for the 7 risk control options for flap rudders (FSA Step 4).  The costs included costs to DNV in developing, administering and implementing the proposed rules, and additional costs to the owner in manufacturing, maintaining and inspecting the rudder. The benefits, in terms of reductions to the risks from rudder failures, were estimated mainly by expert judgement based on available failure data.

If only costs of human, environmental and third-party property damage were included, none of the Risk Control options(RCOs) would have positive net benefits, and all would have an implied cost of annual fatalities (ICAFs) in excess of $200 million. In other words, none of the RCOs could be justified as part of +1A1 Class. However, if damage costs to the ship were included, 4 out of the 7 RCOs have a positive net benefit, and hence are considered suitable for implementation as part of a voluntary class notation.

These conclusions are now being considered as part of DNV’s rule making process. It must be noted that there are major uncertainties in the FSA work, particular in estimating the benefits of the risk control options. In addition, the criteria that in effect limit this type of measure to voluntary class notations are tentative, and not necessarily consistent with other motivations. For these reasons, DNV regard FSA as an input to a decision-making process, rather than the definitive conclusion on it. The rule development process must also consider issues such as market acceptability, data quality and future trends, which at present the FSA cannot model.

 

Discussion

Lessons Learned

Some lessons from the work to date include:

FSA is complex and challenging. Obtaining robust marine risk estimates is difficult, but can be achieved by suitable combinations of historical data, theoretical modelling and expert judgement.

Ship rules are inter-dependent and often their purpose is unclear. Quantifying the benefit of existing ship rules is therefore particularly challenging. FSA is more readily applied to new rules.

Marine accident data sources are incomplete and sometimes difficult to access. While better data would always help the work, it must be acknowledged that much more could be done with the data sources that are available.

Ships are diverse. Even within a generic ship type, there are wide variations in design and operation. Estimation of the risks for average generic ship types is readily achieved using historical data, but the potential variation between individual vessels is largely unknown at present.

Quantification can be controversial. While the costs of damage to ships can be readily quantified, quantification of other accident effects such as delays requires more obscure economic calculations. The important impacts of accidents on people and the environment are particularly difficult to represent in financial terms, but cannot be adequately reflected in the analysis if this is not done.

FSA results are uncertain. As a result of factors such as listed above, the results of any FSA are inevitably uncertain. Independent analyses might obtain numerical results differing by a factor of 10 or more, and some of the conclusions may be sensitive to such uncertainties.

FSA can deliver useful results. While uncertainty limits the reliance that can be placed on the results of an FSA, we find that even uncertain results are more useful than the previous absence of any risk information. Some conclusions are robust against very large uncertainties in the risk estimates, particularly those showing that capital-intensive measures are not effective against specific unlikely accident sequences.

The FSA process is a useful discipline. Even when the results are not yet credible, the process of performing an FSA often gives useful insights into the nature of the risks. The conventional rule development process tends to create a focus on hazards and ways of preventing them happening, while losing sight of the likelihood of accidents and the costs of prevention. FSA has the potential to promote a more holistic view, which will be to the benefit of classification societies, ship-owners and society as a whole.

The cost-effectiveness of FSA is not yet proven. Classification is a competitive business, and for FSA to be adopted widely it must confer a competitive advantage. FSA is resource intensive, and it is not yet clear how to gain the maximum benefit without unnecessary complexity. DNV recognise that FSA will increase the cost of rule developments in the short-term, but anticipate that it will deliver a long-term saving to the industry by showing where rules are not cost-effective and therefore not suitable for development.

 

The Road Ahead

DNV is continuing to develop the foundation for FSA-based ship rule development, by carrying out further generic ship FSAs and pilot rule FSAs. We aim to have completed detailed FSAs of the major generic ship types and pilot rule FSAs of each major type of rule by the end of 2001. This will solve the major technical challenges, and open the way to implement the FSA approach as a routine part of all ship rule development activities.

 

Conclusion

The adoption of FSA seems set to cause a radical change in the way DNV approaches rule development. Justifying new rule proposals in terms of their costs and benefits, explicitly quantified as far as possible, is both challenging and invigorating for the DNV organisation. Early indications are that while it will require a major commitment of resources, this investment will bring major benefits in terms of the consistency and transparency of the rules. The fundamental challenge is to realise the well-known potential of FSA as a proactive, systematic, rational approach to marine safety, while also enhancing the efficiency of safety regulation, to ensure that the investment quickly repays itself and secures widespread acceptance in the marine industry.

 

References

[1]            IMO (1997), “Interim Guidelines for the Application of Formal Safety Assessment (FSA) to the IMO Rule-Making Process”, MSC/Circ.829, International Maritime Organization, London.

[2]            House of Lords (1992), “Safety Aspects of Ship design and Technology”, Select Committee on Science and Technology.

[3]            Kuo, C., Pryke, N., Sodahl, B. & Houison Craufurd, S (1998), “A Safety Case for Stena Line’s High Speed Ferry HSS1500”, Transactions of the Royal Institution of Naval Architects.

[4]            Mathiesen, T-C. & Skjong, R. (1996), “Towards a Rational Approach to Marine Safety and Environment Protection Regulations”, Conference on Market Mechanisms for Safer Shipping and Cleaner Oceans, Rotterdam.

[5]            HSE (1999), “Reducing Risks, Protecting People”, Discussion Document, Health & Safety Executive, London.

[6]            Spouge, J.R. (1998), “Formal Safety Assessment of Helicopter Landing Area on Passenger Ships as a Safety Measure - Additional Information” DNV Report 98-2047.