The song is angry and intensely bitter, expressing Lennon's disillusionment with a world dominated by what he saw as false religion and idols. In common with another theme on the album, the song is also critical of Lennon's former band The Beatles. During the late 1960s, bandmate George Harrison became interested in Eastern mysticism; Lennon dismisses Harrison's beloved gurus and Hare Krishna mantra as "pie in the sky, and refers to "religion from Jesus to Paul"
The instrumentation, style, and production of the song are typical of Lennon's Plastic Ono Band era work. The song features a low, rumbling tremolo guitar, thumping drums, a rolling, minimal bass guitar line, and a scathing vocal delivery. The recording is bare-bones, in stark contrast to the heavy production of Lennon's later albums. It is influenced more heavily by blues music than other songs on Plastic Ono Band
