Java Virtual Machine. A JVM is a piece of software that is responsible for running Java programs. A new JVM is started whenever you type in java program_name on the command line. It is called a virtual machine since it is software that emulates a physical computer. Java programs are built to be run on this virtual machine, allowing them to be run on any real machine that has a JVM.