[Top] [All Lists]

[soa-forum] Fw: New SOA Predictive Metrics

To: soa-forum@xxxxxxxxxxxxxx
From: Niemann.Brand@xxxxxxxxxxxxxxx
Date: Wed, 31 Oct 2007 14:22:58 -0400
Message-id: <OF56E37ADB.A2E21AC4-ON85257385.0064FAF8-85257385.0064FB1A@xxxxxxxxxxxxxxx>

-----Forwarded by Brand Niemann/DC/USEPA/US on 10/31/2007 02:20PM -----

To: "'Paul, Kshemendra'" <Kshemendra.Paul@xxxxxxxxx>, "'George Thomas'" <g.thomas@xxxxxxx>, "Richard Burke" <rburk@xxxxxxxxxxx>
From: "jsalasin" <jsalasin@xxxxxxxx>
Date: 10/19/2007 01:50PM
cc: "'Nick Elkins'" <Nick.Elkins@xxxxxxxxx>, "Jonathan Rich" <Jonathan.Rich@xxxxxxx>, "'Das, Prasanta'" <pdas@xxxxxxxxx>, "'Wittman, Rob'" <rwittman@xxxxxxxxx>, "'Natale, Bob'" <RNATALE@xxxxxxxxx>, "'Victor L Harrison'" <vharris6@xxxxxxx>, "'Frank Stein'" <fstein@xxxxxxxxxx>, "'Allen Brown'" <a.brown@xxxxxxxxxxxxx>, Brand Niemann/DC/USEPA/US@EPA, "Cory Casanave" <cbc@xxxxxxxxxxxxxxxxxxxxxxx>, "'Rob Walker'" <rwalker@xxxxxxx>, "'Paul, Raymond, Dr., NII/DoD-CIO'" <Raymond.Paul@xxxxxxx>, "'Azad M. Madni'" <aMadni@xxxxxxxxxxxxxxxx>, "'Greg Lomow'" <greg.lomow@xxxxxxxxxxxxxxxx>, "'Rob Walker'" <rwalker@xxxxxxx>, "'Charlie P Brown'" <cpbrown@xxxxxxxxxx>, "Joi Grieg" <grieg@xxxxxxxxxx>, "'Lee, Min-Gu'" <min-gu.lee@xxxxxxxx>, <Randy_Leonard@xxxxxxxxxxxxxxxxxx>, "'Thomas Charuhas'" <tcharuhas@xxxxxxxxxxxxxx>, <bobhaycock@xxxxxxxxxxx>, Brand Niemann/DC/USEPA/US@EPA, <Karen.Kaye@xxxxxxx>, "'Harshman, Brad'" <Brad.Harshman@xxxxxxxxxxxx>, "Morton Hirschberg" <Mortfran@xxxxxxx>, "'Mabry, Roy, Mr, NII/DoD-CIO'" <Roy.Mabry@xxxxxxx>, "'Sweet, William H.'" <WILLIAM.H.SWEET@xxxxxxxx>, "'Betsy Lauer'" <BLauer@xxxxxxxx>, "'Daniel Ellis'" <dellis@xxxxxxxxxxxxxxxxx>, "'Arnie Rausch'" <arnie_rausch@xxxxxxxxxx>, "'Betsy Lauer'" <betsy.lauer@xxxxxxxxx>, "'Bricks'" <bricks@xxxxxxxxxxxxxxxxxxx>, "'Chris Brown'" <brownie666@xxxxxxxxx>, "'Chris Brown'" <chris.daniel.brown@xxxxxx>, "'Chris Gunderson'" <Chris.Gunderson@xxxxxxxxx>, "'Chris Gunderson'" <cgunders@xxxxxxxxx>, "'Dave Dikel'" <ddikel@xxxxxxx>, "'David Dikel'" <david_dikel@xxxxxxx>, "'David S Durcsak'" <ddurcsak@xxxxxxx>, "'Dikel David M'" <David.M.Dikel@xxxxxxx>, "'DP'" <dp.5340@xxxxxxxxx>, "'Ed Barger'" <ed.barger@xxxxxxxxxx>, "'Ervin Reeves'" <ervin@xxxxxxxxxx>, "'Ervin Reeves'" <epreeves@xxxxxxxxx>, "'Greg Gardner'" <greg.gardner@xxxxxxxxxx>, "'Hans Polzer'" <hans.w.polzer@xxxxxxxx>, "'Joan Baumstarck'" <joan.baumstarck@xxxxxxx>, "'John Salasin'" <jsalasin@xxxxxxxxxxxxxxxxx>, "'Ken Gill'" <Ken.Gill@xxxxxxxxxxx>, "'Kent Craig'" <Kent.Craig@xxxxxxxxx>, "'Kent Craig'" <barntag@xxxxxxxxx>, "'Moon, Roger H.'" <ROGER.H.MOON@xxxxxxxx>, "'Perry Shelton'" <pshelton@xxxxxxxxxxxxx>, "'RLoeb'" <rloeb@xxxxxxxxxx>, <ryair@xxxxxxxxxx>, "'Dave Chesebrough'" <dchesebrough@xxxxxxxx>, "'Harsh Sharma'" <sharmahw@xxxxxxxxx>, "'Maria Cherkaoui'" <maria.cherkaoui@xxxxxxxx>, "'Chris Harding'" <c.harding@xxxxxxxxxxxxx>, "'Paul, Raymond, Dr., NII/DoD-CIO'" <Raymond.Paul@xxxxxxx>, "'Azad M. Madni'" <aMadni@xxxxxxxxxxxxxxxx>
Subject: New SOA Predictive Metrics

The SOA metrics instrument has been revised based on comments from numerous individuals and reviews presented at the e-Government meeting in McLean on 1-2 October. Their suggestions and comments are deeply appreciated.


It should be easier to complete and produce less variable results. I think it’s at a point where it can provide real benefits to Chief Architects and Program Managers who are building/evolving SOA/EA systems. However, it will still benefit from additional review and testing – retrospectively if not prospectively. Reviews at the e-Government Conference indicated that it was particularly helpful in analyzing a project/program Technology Baseline and Development Plan/Schedule. I’d really appreciate your comments.  While I’ve gone over it 3 or 4 times, you may still find errors. Please let me know.


Changes made, as explained in the Introduction, include:

1)      Adding a section on intended uses for the metrics to the Introduction.

2)      Replacing questions that gauged (predicted or actual) improvement (e.g., in flexibility/modifiability) based on labor hours questions about the tools/languages available for modification. It was impossible to scope a “change task” narrowly enough so answers would be consistent and it would apply to multiple EA systems.

3)      Adding material on Governance in terms of the information that the SOA infrastructure makes available for Governance activities.

4)      Adding some scales about security aspects that have particular applicability to SOA systems.

5)      Adding a sheet of summary metrics.


The metrics are at:


They include an Introduction that explains the rationale behind the metrics and provides some instructions, a data entry form, and an Appendix that explains calculations on the data entry form and suggests potential ways a program might wish to tailor the metrics. 


Any suggestions about how we might publicize the tools availability would be appreciated. This would enable fine tuning of the questions and ranges for “good” (green), “problematic” (yellow), and “bad” (red) in different areas.


I look forward to your or your colleagues’ comments.



John Salasin

National Institute of Standards and Technology (NIST)

(O) 301 975-2923

(M) 240 426-8433


Shared Files:
Community Portal:
Community Wiki:    (01)
<Prev in Thread] Current Thread [Next in Thread>