Relinquishing parental rights is not something the courts take likely. Although not always stated the general standard used bu courts is for "good cause." Relinquishing rights for adoptive purposes is seen in a better light.
The actual process is called "termination." This can be done voluntarily. You would need to seek legal help in your area with the entire process.
Typically, terminating your rights relieves you of any obligation to your child from the date of termination forward. It is doubtful that any jurisdiction would relieve you of past support especially if it can be or is reduced to an order or judgement.
IMPORTANT NOTICE: The Answer(s) provided above are for general information only. The attorney providing the answer was not serving as the attorney for the person submitting the question or in any attorney-client relationship with such person. Laws may vary from state to state, and sometimes change. Tiny variations in the facts, or a fact not set forth in a question, often can change a legal outcome or an attorney's conclusion. Although AttorneyPages.com has verified the attorney was admitted to practice law in at least one jurisdiction, he or she may not be authorized to practice law in the jurisdiction referred to in the question, nor is he or she necessarily experienced in the area of the law involved. Unlike the information in the Answer(s) above, upon which you should NOT rely, for personal advice you can rely upon we suggest you go to AttorneyPages.com and retain an attorney to represent you.