Bad sampling or just bad correlation? I'm currenly trying to do a multivariate analysis to forecast yearly energy consumption for a given building (unit GJ).
A lot of my sample data shows vertical columns when creating a scatter plot.
As my data is not ideally spacially distributed, I suspect the source of these to be that the larger part of my data comes from streets where all buildings have the same specs.
The example below show a correlation analysis for the surface (Oppervlakte in Dutch) of a building (variable originating from the land registry, unit m2).

I suspected that the correlation coefficient wouldn't be very high as a lot of factors determine energy consumption, but I expected at least a usable forecast variable from this one.
The bad distribution of the samples is reflected in de density plots in both histogram and the scatter density.

Suspecting to much of the same type of buildings to be an issue I tried to plot again but only using unique numeric values for surface.
This results in a much higher correlation coefficient and more evenly distributed data, this is the kind of result I would expect:

My questions are the following:

*

*Is the "density blob" / "histogram spike" an indication of bad
sampling?


*Is my way of filtering the data a responsible way or is it better to
use all the data (if this is even possible with such a low
correlation)
Thanks in advance,
Michaël
(Are plots are using Seaborn in Python)

Thanks for the answers so far! :)
@Ben
The consumption samples are an export from the database of a company that does provide a billing platform for energy suppliers. The data is bound to their customers and the bulk of the data is from their few biggest customers. As each customer usually operates within a single city, the data could be way better distributed spatially. The predictive variables are rather scarce as I depend on public datasets to build a model. Volume would indeed be a way better predictor than surface alone, but the registry doesn't provide it. Surface is the living space, so only the floor surfaces of a building.
Thanks for the log-log regression tip, will have a look at that!
@Tanner
It was my understanding that a predictive variable has to be quasi normally distributed to be usable for a regression model. Ben's suggestion to also try log scales looks interesting.
Creating synthetic results was indeed my fear in this and this was the primary reason to ask my questions here.
There doesn't seem to be a rule as to usable correlation coeffients lower bounds. Only the general rule of > 0.5 being significant. What is your experience in this? Anything >0.25?

High Level: Your question doesn't have a "pure" mathematical answer per se, it really depends on context, but there are some principles we can use to think about this.
First to directly address your questions:
Is the "density blob" / "histogram spike" an indication of bad sampling? No, unless you know something specific. Your data could have any type of distribution, there is no garuntee that it is random / normally distributed. A common misconception is that large samples of data have a tendency towards normality. This is not true. You data distribution can look like anything, and that really doesn't tell us anything about your sampling.
Is my way of filtering the data a responsible way or is it better to use all the data (if this is even possible with such a low correlation)? To be honest I don't love it. The issue you seem to have with your data is it is censored to nearby values; the estimates are "rough" and not very precise. However, assuming this censoring is more-or-less random, it really shouldn't effect your statistical analysis. Sure, the graph looks a little funny, but it doesn't really change your analysis. I'd argue the reason you're getting a higher correlation with the reduced data is because you're oversampling from points on the high and low points of the distribution (where the variance tends to be lower based on your graphs) and undersampling from the middle (where your variance tends to be higher). So you're synthetically creating a data set that is overly confident.
Putting this all together: there is no reason to suspect your distribution is wrong based on the histogram. Your goal in sampling is to get as close to a random sample as possible. If your random sample includes a lot of building with the same specs... then that's you're true distribution, and you shouldn't change it.
An important point: An r of 0.28 may feel low for the type of data you're used to, but it really is quite usable, and sometimes that's just the kind of correlation you get in real life.
