Hello Filippos,
it would sound like it is feasible (note that there also is a PatchMatch wikipedia page). A month ago, Francisco Massa suggested a possible approach for implementation that should be relatively easy to follow:
Of course, we’d love to see your implementation once it is done.
Best regards
Thomas