The popularity of Software Defined Network (SDN) is due to its ability to simplify and automate operational network processes to improve service performance. SDN is not only related to the separation of control plane and data plane, but its architecture also includes network services at other top tiers such as load balancing, security, and application performance. Load balancing is a technique to divide traffic loads equally. The correct load balancing algorithm will make the network better stable because network resources must always be operational and available to cope with the increasing demand for services and service users. Scalability and diversity of services on the network such as HTTP, FTP, and VoIP are also concerned with selecting the proper load balancing algorithms. SDN-based software makes it easy to develop and integrate with other software and hardware. This study implemented a load balancing algorithm using an L4-L7 load balancer connected with an SDN controller, ONOS, which automates traffic load sharing on a Web server, FTP server, and VoIP server. The scheduling algorithms used are round robin, least connection, dynamic ratio, and ratio. The test parameters used are Throughput, Response time, Request loss, Block call, and CPU Utilization.