Use Krud Kutters which work great!
Although this link is from a company selling a product, this is a great article for both indoor and outdoor brick floors. The product is not used in the article. Wishing you the best.
WD 40 will clean almost anything