Solved by ptrblck in post #4 
              
              
                Oh, I clearly misunderstood your use case, sorry! 
I thought the kernel would be the dotted line in your figure, but I’ve apparently didn’t read the indices carefully enough. 
So basically you have a weight for each input value. Both of my approaches use some kind of weight sharing and are not doing…