So, thanks to Achim, in the rmrk-tools repo, you can use: https://github.com/rmrk-team/rmrk-tools#fetchremarks
fetchRemarks(api, to, from, prefixes); method call
It's not pretty but it's a start:
async function getRmrks(){
const wsProvider = new WsProvider('wss://kusama-rpc.polkadot.io');
const ADDR = <QUERY_ADDRESS_OF_NFT_MINT>;
const api = await ApiPromise.create({ provider: wsProvider });
const remarkBlocks = fetchRemarks(api, 12128900, 12128990, [''])
.then( (remarkBlock) => {
remarkBlock
.forEach((block)=>{
block.calls
.filter((obj) =>{
if(obj.caller === ADDR) {
console.log(obj);
}
});
});
});