Is there an option where we can insert a paid or not paid stamp on the invoices TaxCycle generates?
Not exactly but you can enter the amount paid in the billing section and if your invoice template is setup to reflect this (is by default) then that amount will show on your invoice.