This hymn has been wrongly attributed to George Burder, according to Odenheimer and Bird in Songs of the Spirit: hymns of prayer and praise to God the Holy Ghost, 1871. Their source was a Mr. Sedgewick. Duffield in English Hymns: Their Authors and History, 1866 gives the source as D. Sedgwick.
Come, Holy Spirit, calm my [our] mind. [Whitsuntide]. We have traced this hymn to A Collection of Psalms and Hymns for the use of the Lock Chapel, 1803, where it is the first hymn to be sung before Divine Service, in 3 stanzas of 4 lines. In Bickersteth's Christian Psalmody, 1833, it has an additional stanza, and in this form it is repeated in the Eng. Presbyterian Church Praise, 1883. It is sometimes attributed to "John Stewart;" but we have failed to find authority for the statement. The 3 stanza form of the text is given in Common Praise, 1879, as by “Browne." This we regard as an error. [William T. Brooke]
--John Julian, Dictionary of Hymnology, Appendix, Part II (1907)