Introduction: The Watchful Eye
In Lessons 3.1, 3.2, and 3.3, we established the foundations of security architecture, examined network security controls, and analyzed secure remote access solutions. We explored firewalls, intrusion detection and prevention systems, and VPNs. However, even with strong perimeter defenses and secure remote access, threats can still penetrate the network. Financial institutions must continuously monitor their networks to detect and respond to threats in real-time.
Network MonitoringΒ is the practice of continuously observing network traffic, systems, and applications to detect anomalies, threats, and performance issues. It is the foundation of the “Detect” function in the NIST CSF. A well-designed network monitoring capability provides:
-
Visibility:Β Understanding what is happening on the network at all times.
-
Detection:Β Identifying threats and anomalies.
-
Investigation:Β Providing data for incident investigation.
-
Response:Β Enabling rapid response to threats.
This lesson provides a comprehensive analysis of network monitoring and Security Information and Event Management (SIEM) for financial institutions. We begin by examining theΒ Network Monitoring Components: sensors, collectors, analyzers, and dashboards. We derive theΒ Network Monitoring Coverage Score:Β Cmonitor=CoverageΓDepthΓTimeliness.
We then examineΒ Security Information and Event Management (SIEM)Β , including log collection, correlation, alerting, and reporting. We derive theΒ SIEM Effectiveness Score:Β ESIEM=CollectionΓCorrelationΓAlertingΓReporting. We analyze theΒ SIEM Use CasesΒ for financial institutions.
We also examineΒ Threat Detection Techniques, including signature-based detection, anomaly detection, and behavioral detection. We derive theΒ Threat Detection Score:Β Dthreat=SensitivityΓSpecificityΓTimeliness.
By the end, you will have a complete understanding of network monitoring and SIEM, and be able to design and implement a comprehensive monitoring capability for a financial institution.
Learning Objectives
Upon completion of this lesson, you will be able to:
-
AnalyzeΒ theΒ Network Monitoring Components: sensors, collectors, analyzers, and dashboards.
-
DeriveΒ theΒ Network Monitoring Coverage Score:Β Cmonitor=CoverageΓDepthΓTimeliness.
-
AnalyzeΒ Security Information and Event Management (SIEM)Β .
-
DeriveΒ theΒ SIEM Effectiveness Score:Β ESIEM=CollectionΓCorrelationΓAlertingΓReporting.
-
AnalyzeΒ Threat Detection Techniques: signature-based, anomaly-based, and behavioral-based detection.
-
DeriveΒ theΒ Threat Detection Score:Β Dthreat=SensitivityΓSpecificityΓTimeliness.
-
DesignΒ a network monitoring and SIEM solution for a financial institution.
Part 1: Network Monitoring Components
1.1 The Monitoring Architecture
The network monitoring architecture consists of four components:
Monitoring={Sensors,Collectors,Analyzers,Dashboards}
1.2 The Four Components
| Component | Description | Examples |
|---|---|---|
| Sensors | Capture and generate data | Network sensors, endpoint agents, application logs |
| Collectors | Aggregate and store data | SIEM collectors, log aggregators |
| Analyzers | Analyze data for threats | Correlation engines, anomaly detection |
| Dashboards | Visualize data and alerts | Security dashboards, alert consoles |
1.3 The Network Monitoring Coverage Score
The Network Monitoring Coverage Score quantifies the effectiveness of network monitoring:
Cmonitor=CoverageΓDepthΓTimeliness
Where:
-
CoverageΒ is the Coverage Score (0-1)
-
DepthΒ is the Depth Score (0-1)
-
TimelinessΒ is the Timeliness Score (0-1)
| Component | Description | Scoring Factors |
|---|---|---|
| Coverage (C) | Percentage of network monitored | Network segments, endpoints, applications |
| Depth (D) | Level of monitoring detail | Packet capture, flow data, logs |
| Timeliness (T) | Speed of detection | Latency between event and detection |
Network Monitoring Architecture (Visual): βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | | | Sensors β | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β β’ Network sensors (packet capture, flow data) β β | β β’ Endpoint agents (EDR, antivirus) β β | β β’ Application logs (web servers, databases) β β | β β’ Security devices (firewalls, IDS/IPS) β β | ββββββββββββββββββββββββββ¬βββββββββββββββββββββββββββββββββββββββββ β | β | | βΌ | | Collectors β | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β β’ SIEM collectors β β | β β’ Log aggregators β β | β β’ Data lake storage β β | ββββββββββββββββββββββββββ¬βββββββββββββββββββββββββββββββββββββββββ β | β | | βΌ | | Analyzers β | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β β’ Correlation engines β β | β β’ Anomaly detection β β | β β’ Threat intelligence β β | β β’ User and entity behavior analytics (UEBA) β β | ββββββββββββββββββββββββββ¬βββββββββββββββββββββββββββββββββββββββββ β | β | | βΌ | | Dashboards β | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β β’ Security dashboards β β | β β’ Alert consoles β β | β β’ Reporting tools β β | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Part 2: Security Information and Event Management (SIEM)
2.1 The SIEM Definition
SIEM is a security solution that provides real-time analysis of security alerts and logs from various sources.
SIEM={Collection,Correlation,Alerting,Reporting}
2.2 The SIEM Components
| Component | Description | Function |
|---|---|---|
| Collection | Collects logs from various sources | Log aggregation, normalization |
| Correlation | Correlates events across sources | Threat detection, pattern recognition |
| Alerting | Generates alerts for security events | Real-time notification, escalation |
| Reporting | Generates reports for compliance | Compliance reporting, incident investigation |
2.3 The SIEM Effectiveness Score
The SIEM Effectiveness Score quantifies the effectiveness of a SIEM:
ESIEM=CollectionΓCorrelationΓAlertingΓReporting
Where:
-
CollectionΒ is the Collection Score (0-1)
-
CorrelationΒ is the Correlation Score (0-1)
-
AlertingΒ is the Alerting Score (0-1)
-
ReportingΒ is the Reporting Score (0-1)
| Component | Description | Scoring Factors |
|---|---|---|
| Collection (C) | Coverage of log sources | Number of sources, types of logs |
| Correlation (C) | Effectiveness of correlation | Detection rate, false positive rate |
| Alerting (A) | Effectiveness of alerting | Alert quality, response time |
| Reporting (R) | Effectiveness of reporting | Compliance coverage, data quality |
2.4 SIEM Use Cases for Financial Institutions
| Use Case | Description | Examples |
|---|---|---|
| Threat Detection | Detecting known and unknown threats | Malware detection, intrusion detection |
| Compliance | Meeting regulatory requirements | GLBA, SOX, GDPR, NYDFS |
| Incident Investigation | Investigating security incidents | Log analysis, forensic investigation |
| Security Monitoring | Monitoring security posture | Dashboards, alerts, reporting |
SIEM Architecture (Visual): βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | | | Data Sources β | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β β’ Firewalls β β | β β’ IDS/IPS β β | β β’ VPNs β β | β β’ Servers β β | β β’ Applications β β | β β’ Cloud Services β β | ββββββββββββββββββββββββββ¬βββββββββββββββββββββββββββββββββββββββββ β | β | | βΌ | | SIEM Platform β | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β β Log Collection & Normalization ββ β | β β β’ Agents, Syslog, API ββ β | β β β’ Parsing, Normalization ββ β | β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β β Event Correlation ββ β | β β β’ Rules, Correlation Engines ββ β | β β β’ Threat Intelligence Integration ββ β | β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β β Alerting & Notification ββ β | β β β’ Real-time Alerts ββ β | β β β’ Escalation ββ β | β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β β Reporting & Dashboards ββ β | β β β’ Compliance Reports ββ β | β β β’ Operational Dashboards ββ β | β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | ββββββββββββββββββββββββββ¬βββββββββββββββββββββββββββββββββββββββββ β | β | | βΌ | | Outputs β | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | β β’ Alerts β β | β β’ Reports β β | β β’ Dashboards β β | β β’ Investigations β β | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ β | | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ
Part 3: Threat Detection Techniques
3.1 The Detection Methods
Threat detection techniques can be categorized into three types:
Detection={Signature-Based,Anomaly-Based,Behavioral}
3.2 Signature-Based Detection
Definition:Β Signature-based detection matches known threat signatures.
Signature-Based={Signatures,Matching,Alerts}
Advantages:
| Advantage | Description |
|---|---|
| Accuracy | Low false positive rate |
| Speed | Fast detection |
| Simplicity | Easy to implement |
Disadvantages:
| Disadvantage | Description |
|---|---|
| Limited Coverage | Cannot detect unknown threats |
| Maintenance | Requires constant signature updates |
3.3 Anomaly-Based Detection
Definition:Β Anomaly-based detection detects deviations from normal behavior.
Anomaly-Based={Baseline,Deviation,Alerts}
Advantages:
| Advantage | Description |
|---|---|
| Unknown Threat Detection | Can detect novel threats |
| Adaptability | Adapts to changing environment |
Disadvantages:
| Disadvantage | Description |
|---|---|
| False Positives | Higher false positive rate |
| Complexity | Requires baseline establishment |
3.4 Behavioral Detection
Definition:Β Behavioral detection detects suspicious behavior patterns.
Behavioral={BehaviorΒ Patterns,Anomalies,Alerts}
Advantages:
| Advantage | Description |
|---|---|
| Contextual Understanding | Understands context of behavior |
| Advanced Threat Detection | Detects sophisticated attacks |
Disadvantages:
| Disadvantage | Description |
|---|---|
| Complexity | Requires advanced analytics |
| Data Requirements | Requires large amounts of data |
3.5 The Threat Detection Score
The Threat Detection Score quantifies the effectiveness of threat detection:
Dthreat=SensitivityΓSpecificityΓTimeliness
Where:
-
SensitivityΒ is the Sensitivity Score (0-1)
-
SpecificityΒ is the Specificity Score (0-1)
-
TimelinessΒ is the Timeliness Score (0-1)
| Component | Description | Scoring Factors |
|---|---|---|
| Sensitivity (S) | Detection rate | True positive rate |
| Specificity (S) | False positive rate | False positive rate |
| Timeliness (T) | Speed of detection | Detection latency |
Threat Detection Techniques (Visual): βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | | | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | | β Signature-Based Detection β | | β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£ | | β Description: Matches known threat signatures β | | β Examples: Snort, Suricata, antivirus β | | β Advantages: Accurate, Fast β | | β Disadvantages: Limited coverage, requires updates β | | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | | | | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | | β Anomaly-Based Detection β | | β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£ | | β Description: Detects deviations from normal behavior β | | β Examples: Statistical models, machine learning β | | β Advantages: Unknown threat detection, adaptable β | | β Disadvantages: Higher false positives, complexity β | | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | | | | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | | β Behavioral Detection β | | β ββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ£ | | β Description: Detects suspicious behavior patterns β | | β Examples: UEBA, advanced threat detection β | | β Advantages: Contextual understanding, advanced detection β | | β Disadvantages: Complexity, data requirements β | | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ | | | βββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββββ