Enhancing Network Security and Throughput via Integrated Firewall Filtering, Token Substitution, and Dynamic XOR Ciphering

The exponential growth of cloud computing, edge networks, and enterprise data transfers has magnified the demand for robust information security and high-efficiency network transmission. Existing network defense frameworks predominantly deploy perimeter firewalls and payload encryption as independent security layers. However, executing heavy cryptographic algorithms such as asymmetric RSA or DNA encryption on uncompressed data streams introduces significant computational latency, severe packet payload inflation, and heightened packet drop probability under traffic congestion. This study proposes an integrated hybrid network security framework that harmonizes stateful firewall port control, dictionary-based token replacement payload compression, and dynamic XOR cipher encryption into a unified communication architecture. In the proposed paradigm, outgoing text payloads undergo tokenized substitution using a database lookup mapping prior to cryptographic transformation, effectively shrinking packet size and diminishing encryption complexity. The compressed payload is subsequently encrypted via session-key XOR operations and transmitted across user-defined socket ports validated by server-side firewall access rules. The system was implemented using Java in a NetBeans environment with ODBC MS Access mapping and validated through MATLAB network traffic simulations across variable packet workloads ranging from 10 to 60 packets. Empirical results demonstrate that the integrated framework reduces mean transmission time consumption from 2.817 s (RSA baseline) to 2.075 s (p = 0.00955), cuts payload overhead from 23.83 KB to 14.83 KB (a 37.77% reduction, p = 0.00494), lowers transmission error rates from 2.58% to 1.87% (p = 0.00800), and reduces Man-in-the-Middle packet vulnerability by 50.00% (p = 0.00143). This integrated approach provides a high-throughput, low-latency security mechanism for enterprise and cloud computing environments.