top of page
Writer's pictureSunil Dutt Jha

Unveiling the ICMG Awards Process: IT Project Evaluation Explained

The ICMG Enterprise Strategy & Architecture Awards celebrate excellence in enterprise strategy and architecture. This blog focuses on evaluating IT projects, emphasizing the importance of distinguishing between project management efforts and genuine architectural work. The evaluation process ensures that the architecture not only supports immediate implementation but also adapts to ongoing business and technology changes.



Six Perspectives and Six Variables

The ICMG Awards evaluate IT projects across six perspectives, each refined by six variables. This comprehensive framework ensures a holistic assessment of the enterprise architecture.

Six Perspectives

  1. Goals/Strategy: Aligning architecture with business objectives and strategic direction.

  • Evaluation: Includes strategic models, stakeholder engagement, and alignment with business strategy.

  1. Business/Process: Optimizing business processes and workflows.

  • Evaluation: Involves process optimization, workflow integration, and business process management.

  1. System/Models: Designing system architecture and integration.

  • Evaluation: Includes system design, architecture models, and integration strategies.

  1. Technology/Components: Implementing IT components and infrastructure.

  • Evaluation: Assesses the choice, implementation, and performance of IT components and infrastructure.

  1. Implementation: Executing and deploying the architecture.

  • Evaluation: Involves methodologies, project management, and deployment strategies.

  1. Operations: Ensuring operational efficiency and sustainability.

  • Evaluation: Includes operational management, performance monitoring, and continuous improvement.


Six Variables

The perspectives of Systems and Technology/Components are further assessed using six variables to ensure a detailed and comprehensive evaluation.

  1. Data: Managing and utilizing data effectively.

  • Evaluation: Ensures data is accurately captured, stored, and utilized across the architecture.

  1. Rule: Establishing rules and policies for governance.

  • Evaluation: Assesses the rules and policies governing the architecture and their implementation.

  1. Location/Network: Structuring locations and networks for optimal performance.

  • Evaluation: Ensures efficient network infrastructure and optimal location strategies.

  1. Timing/Events: Managing timing and events to ensure smooth operations.

  • Evaluation: Assesses how events and timing are managed to maintain operational efficiency.

  1. Role/UI: Defining roles and user interfaces for seamless interaction.

  • Evaluation: Ensures user roles are well-defined and interfaces are user-friendly and effective.

  1. Function/Processing: Ensuring efficient processing and functionality.

  • Evaluation: Assesses how well the architecture supports required functions and processes efficiently.


Detailed Evaluation Criteria

Round 1: Initial Screening

In the initial screening, 1-2 key parameters from each perspective are evaluated to get a basic assessment.

Category

Criteria

Proven Effectiveness

Goals/Strategy

Alignment with business objectives and strategic goals

🟢


Stakeholder engagement and satisfaction

🟢

Business/Process

Process optimization and efficiency

🟠


Workflow integration and management

🟠

System/Models

System architecture design and integration

🔴


Scalability and flexibility of the system

🔴

Technology/Components

Choice and implementation of technology components

🟢

Round 2: Online Evaluation

In the second round, additional parameters from each perspective are evaluated for a more comprehensive assessment.

Category

Criteria

Proven Effectiveness

Goals/Strategy

Strategic models and frameworks used

🟢


Long-term vision alignment

🟠

Business/Process

Business process modeling and reengineering

🟠


Workflow integration and efficiency

🟠

System/Models

Use of architecture models and best practices

🔴


System scalability and flexibility

🔴

Technology/Components

Performance and reliability of IT infrastructure

🟢


Integration with existing technology stack

🟢

Implementation

Project planning and execution strategies

🟠


Methodologies and approaches used in deployment

🟠

Operations

Operational management and monitoring

🔴


Performance indicators and metrics

🔴

Round 3: Regional Excellence

In the regional excellence round, each perspective is covered more comprehensively, with a focus on providing detailed feedback on each perspective.

Category

Criteria

Proven Effectiveness

Goals/Strategy

Strategic impact and contribution to business objectives

🟢


Stakeholder engagement and communication

🟢

Business/Process

Process efficiency improvements and optimization

🟠


Workflow management and process integration

🟠

System/Models

Robustness and flexibility of system architecture

🔴


Effective use of system models and integration

🔴

Technology/Components

Choice and implementation of technology components

🟢


Performance and reliability of IT infrastructure

🟢

Implementation

Risk management and mitigation strategies

🟠


Execution methodologies and deployment strategies

🟠

Operations

Operational management and monitoring

🔴


Continuous improvement and adaptability

🔴

Project Complexity

Scale and scope of the project

🟢


Complexity of interlinked components

🟢


Resource allocation and management

🟢

Round 4: Global Excellence

In the global excellence round, in addition to covering all perspectives comprehensively, the interlinking between perspectives and the project's relevance in the context of the enterprise are also evaluated.

Category

Criteria

Proven Effectiveness

Goals/Strategy

Long-term strategic alignment and vision

🟢


Comprehensive stakeholder engagement

🟢

Business/Process

Advanced business process modeling and optimization

🟠


Workflow efficiency and integration

🟠

System/Models

Advanced system architecture design and integration

🔴

Evaluation Rounds

The ICMG Awards are structured into four distinct rounds, each with a specific focus and format of interactions:

Evaluation Round

Format of Interactions

Evaluation Focus

Round 1: Initial Screening

Online Submission and Review

Basic assessment across all perspectives, evaluating 1-2 key parameters from each perspective.

Round 2: Online Evaluation

Detailed Documentation and Virtual Meetings

Comprehensive evaluation, covering additional parameters across all perspectives.

Round 3: Regional Excellence

Onsite Presentations and Review

In-depth evaluation across all perspectives, focusing on additional parameters and feedback on each perspective.

Round 4: Global Excellence

In-Person Presentations and Final Review

Comprehensive evaluation, focusing on interlinking between perspectives and project relevance in the enterprise context.

Key Evaluation Aspects

Project Complexity :Evaluates the scale and scope of the project.

  • Projects are assessed based on their size, intricacy, and the range of components involved. Complex projects with multiple interconnected elements require a robust architectural foundation to ensure seamless integration and functionality.


Performance Indicators :Metrics and benchmarks for success.

  • These are quantifiable measures used to evaluate the performance and effectiveness of the architecture. Performance indicators might include system uptime, response times, user satisfaction, and return on investment (ROI). High-performing architectures demonstrate clear, measurable benefits.


Technology Models : Innovation and effectiveness of technology solutions.

  • This aspect looks at the use of cutting-edge technologies and how effectively they are implemented. Innovative technology models that solve business problems efficiently and can adapt to future needs are highly valued.


Stakeholders and Key Expectations : Alignment and satisfaction of key stakeholders.

  • Ensuring that the architecture meets the expectations and needs of various stakeholders, including executives, employees, and customers, is crucial. This involves clear communication, engagement, and alignment with business objectives.


Architecture Governance : Compliance with governance frameworks and standards.

  • Governance involves the policies, procedures, and standards that ensure the architecture is managed and maintained effectively. Strong governance frameworks ensure compliance, security, and alignment with organizational goals.


Implementation Models : Methodologies and approaches used in deployment.

  • This assesses the strategies and methodologies used to implement the architecture. Effective implementation models ensure that the architecture is deployed smoothly, efficiently, and with minimal risk.



Well-defined Taxonomy : Clarity and consistency in architectural terms and definitions.

  • A well-defined taxonomy ensures that all architectural components are clearly defined and consistently used across the organization. This clarity helps in understanding, managing, and evolving the architecture.



Interlinking of Perspectives : Integration and alignment of the six perspectives.

  • This evaluates how well the six key perspectives (Strategy, Process, Systems, Components, Implementation, Operations) are integrated and aligned. Effective interlinking ensures that the architecture functions as a cohesive whole, with each perspective supporting and enhancing the others.




Focus on Architectural Foundation

The ICMG Awards emphasize the architectural foundation as the cornerstone of enterprise architecture. This means that the evaluation focuses on:

  • Principles and Frameworks: The core principles that guide the architecture and the frameworks used to structure it.

  • Strategic Impact: How the architecture influences and supports strategic business objectives.

  • Long-term Sustainability: The ability of the architecture to remain relevant and effective over time, accommodating changes in the business environment.


Evaluation of Architectural Implementation and Operational System

An important aspect of the ICMG Awards evaluation is examining whether the architecture models were only used during the planning phase or if they continue to be beneficial in managing the operational system or enterprise. The evaluation looks into:

  • Implementation Success: How well the architecture was implemented and whether it has achieved its intended goals.

  • Operational Use: Whether the architecture is actively used in the operational management of the system or enterprise.

  • Adaptability: The architecture's ability to handle ongoing business and technology changes.


The ICMG Enterprise Strategy & Architecture Awards are rigorous and comprehensive, focusing on the strategic and foundational elements of enterprise architecture. By distinguishing between project management and architectural efforts, and emphasizing the importance of an architectural foundation, the awards set a high standard for excellence.


Participants who can demonstrate a robust and adaptable architecture that supports their enterprise strategy are well-positioned to achieve recognition and benchmark their projects against global standards. This approach not only enhances the quality of submissions but also drives continuous improvement and innovation in the field of enterprise architecture.

2,812 views

Enterprise Intelligence

Transforming Strategy into Execution with Precision and Real Intelligence

bottom of page