+ Evolutionary Algorithm Parameter Space Reduction

Examples: NSGAII Non-Dominated Sorting Genetic Algorithm II HYPE Hypervolume Estimation Algorithm for Multi-Objective Optimization SPEA2 Strength Pareto Evolutionary Algorithm 2

+ Evolutionary Algorithm Parameter Space Reduction

+ Owned Infrastructures Expensive

+ Web Service High Accessibility

+ Web Service High Accessibility

+ MapReduce + Service Contract High Fault Tolerance High Availability

MANA Map Aware Non-Uniform Automata Wargame Simulation Scenario Excursion

Hadoop Cluster @NTU

Hadoop Controller

Learn From Failures & Implement

Cluster Techniques
Enable Rack Awareness Add 6 Virtual Machines

Programming Strategies
Close Distributed File Properly Specify Replication Factor

Web Application Web Service

Physical Node 1-Click Installer Node Auto-Updater MapReduce Models

Island MapReduce 1 Replication Model

Evolutionary Algorithm: NSGAII Generations: 100 Population Size: 100 Replications For Each Individual: 30 Experiment Runs: 10

Optimal Number Of Nodes Used

Simple Scenario: 10 Complex Scenario: 20

Optimal Number Of Nodes Used To Maximize Speedup Depends On The Scenario

Evolutionary Algorithm: HYPE & SPEA2 Generations: 100 Population Size: 500 Replications For Each Individual: 30 Migration Topology/Size/Interval: Ring/10%/5 Migration Policy: Random(Best)-Random Experiment Runs: 3

Convergence
Similar Hypervolumes

Diversity
Better Than Standard Model (HYPE/SPEA2)

Exploiting Exploring

Best Combination: Combine Exploiting & Exploring Algorithms

MapReduce Models STD_HYPE STD_SPEA2 ISD_HYPE_SPEA2

Mean Diversity Index 15.67 16.0 19.33

Evolutionary Algorithm: NSGAII Generations: 50 Population Size: 40 Replications For Each Individual: 30 Experiment Runs: 10

Use of AMI Provides Ease In Scaling Fixed Public IP Address

Ease In Setup

Best Option
Solutions To Dynamic Private IP Address (Which Results In Setup Difficulties): 1. Always-On Master Node 2. Programmatic Method

Use of AMI Provides Ease In Scaling Fixed Public IP Address

Ease In Setup

Best Option
Solutions To Dynamic Private IP Address (Which Results In Setup Difficulties): 1. Always-On Master Node 2. Programmatic Method

Log Collection & Analysis

Current Method
Self-Written Program To Collect & Combine All Selected Logs, But Require Manual Activation & Analysis

Chukwa uses Hadoop

Security
HTTPS + SSL Hadoop + Kerberos

Evolving Agent-Based Simulations in the Clouds

3rd International Workshop on Advanced Computational Intelligence (IWACI 2010)

Cloud Computing & Island Model

Defence Science Research 2011 Conference & Expo Tentative

http://pdcc.ntu.edu.sg:8080/HadoopService/ hadoop_cluster.jsp http://pdcc.ntu.edu.sg/hadoop/service/hadoo p_service.php http://pdcc.ntu.edu.sg:8080/HadoopService/ HadoopService?Tester