ExaMeld’s Log Analysis module transforms massive log files into searchable, analyzable datasets. By combining compression, pattern extraction, and full-text indexing, the module enables rapid investigation of multi-gigabyte log collections that would otherwise demand extensive manual review.
Log Location Management
The location management system enables definition of custom log file locations and file matching patterns, allowing inclusion of logs from application directories, system paths, and remote locations. Individual locations can be selectively enabled or disabled without removing configuration, facilitating rapid context switching between monitoring different system components or application stacks.
Indexing Pipeline
The indexing pipeline optimises both compression and searchability. Log content is compressed at ratios of 10:1 to 50:1 depending on repetitiveness, dramatically reducing storage requirements. Structured data is then extracted through pattern matching, converting unstructured log lines into searchable, indexed fields. Progress tracking provides visibility into large indexing operations, with real-time compression ratio estimates.
Full-Text Search
Powerful search supports field matching, wildcards, and boolean operators, enabling precise queries across indexed log data. Recent search history enables rapid repetition of common queries. Layout modes accommodate different analysis workflows: Both mode displays compressed files and search results together, Summary mode focuses on aggregate statistics, and File mode zooms into individual log files.
Template Pattern Analysis
Automatic template extraction identifies recurring patterns within log files using <*> placeholders for variable data. Extracted variables are ranked by frequency, enabling rapid identification of common events and anomalies. Per-file breakdown shows template distribution within each indexed file, supporting targeted deep-dive analysis.
Integrated Log Viewer
A high-performance viewer opens and scrolls through gigabyte-plus log files that would crash or freeze traditional text editors. Full upward and downward scrolling works seamlessly regardless of file size, with content loaded on-demand so the application remains responsive even with multi-million-line files. A position slider enables rapid navigation to any point in the file, while result navigation automatically jumps to search matches. Syntax-aware highlighting distinguishes timestamps, severity levels, and structured fields for improved readability.
Storage and Performance
Compressed storage statistics display space savings achieved through indexing operations, enabling informed decisions about which log locations to maintain. Configurable load sizes balance responsiveness with memory usage, accommodating deployment environments with varying resource constraints.