text:
Q: In bash, how to find all copies of a given file in particular directories? Let's say we have a file /a_long_path_1/foo.doc of size, say, 12345 bytes, and we would like to find all copies of this file in directories /a_long_path_2 and /a_long_path_3 including all their subdirectories recursively. The main parts of the names of the copies may differ from foo (though the extension .doc is likely to stay the same), and the creation/modification dates may be different, but the contents of foo should be the same in its duplicates.
If I issue find /a_long_path_2 /a_long_path_3 -size 12345c -iname \*.doc, the list I get is too large to check manually via diff. Automation is needed.  Additional info that might make automation hard: some directory names in the output of this find … command contain spaces.
To be clear: I do NOT wish to find all duplicates of all files on the file system (but all duplicates of only of one particular file), not even as an intermediate step. (Such a list would be huge anyway.)

A:
If I issue find /a_long_path_2 /a_long_path_3 -size 12345c -iname \*.doc, the list I get is too large to check manually via diff. Automation is needed.

Add -exec cmp -s /a_long_path_1/foo.doc {} \; -print:
find /a_long_path_2 /a_long_path_3 \
   -type f \
   -size 12345c \
   -iname \*.doc \
   -exec cmp -s /a_long_path_1/foo.doc {} \; \
   -print

This works because in find -exec is also a test, it succeeds iff the invoked tool returns exit status 0. cmp -s silently returns exit status 0 iff the two given files are identical.
-iname \*.doc can speed things up, but in general it may make you miss some duplicates. -type f and -size 12345c are good preliminary tests for sure.

redpajama_set_name: RedPajamaStackExchange


Check out a moving Hiro Murai-directed clip for the You're Dead! highlight.
The eerie, jazzy, Kendrick Lamar-featuring "Never Catch Me" is an early favorite of ours from Flying Lotus's upcoming You're Dead!, so we're psyched that it's just gotten moving, lovely video treatment from Hiro Murai. In the clip, two children wake up during their own funeral services and deliver some energetic dance moves as they drive off into the sunset. Check it out - and remember, You're Dead! is out October 7th.


A resident of Jamaica Plain, Liz Malia has represented the 11th Suffolk district in the MA House since 1998. Liz, an openly LGBTQ member of the Massachusetts legislature, co-founded the Bay State Gay and Lesbian Democrats in the 1980s. She chairs the Joint Committee on Mental Health and Substance Abuse, and has worked during her tenure to make community development processes more inclusive and transparent. Born in Endicott, N.Y., in 1949, Liz is a graduate of Boston College who attended the Women in Politics and Government program at UMass Boston. MassEquality PAC is pleased to endorse her campaign for re-election.
Categories: Endorsements | Tags: Liz Malia, Massachusetts State Representative | Permalink.


The Zurich Instruments HF2LI (high-frequency, 2 inputs) is a digital lock-in amplifier covering the frequency range between DC and 50 MHz. It features 2 physical input channels so that it can replace 2 devices in many measurement setups. The 128-bit digital signal processing delivers superior precision thus boosting both the noise performance and the dynamic reserve. With these unprecedented capabilities, the HF2LI brings lock-in amplification to a new level and enables new applications in a frequency range that was previously tied to analog instrumentation. The computer is connected by a high-speed USB interface, which allows data acquisition at high rates. The HF2LI is delivered with a fully featured graphical user interface and a choice of programming interfaces that greatly add to the usability of the instrument.
The HF2LI-MOD is an option for the HF2LI and allows for the direct analysis of sidebands in dynamic AM (amplitude modulation) and FM (frequency modulation) schemes. This option helps the user to precisely measure periodic variations in the frequency or the amplitude of the application signal. Such schemes are typically applied in oscillator and resonator related setups.
The HF2LI-PLL is an option for the HF2LI and essentially provides a dual programmable digital phase-locked loop which enables fast frequency tracking. Zurich Instruments offers the world's fastest digital PLL, with a unique frequency range of up to 50 MHz using direct sampling technology. In combination with the multi-frequency and the AM/FM modulation options, the HF2LI can be considered as a ground breaking measurement tool for all advanced oscillation applications.
The HF2LI combines the latest analog front-end circuits, for signal sampling, and high-performance digital signal processors.
The 2 input paths of the HF2LI are optimized for very low noise operation. The sampling rate of 210 MSa/s is 4-times the analog bandwidth to ensure full capture of the signal and to avoid aliasing.
The HF2LI generates 2 high-frequency outputs as a linear combination of up to 6 sinusoids in the range from DC to 50 MHz. The amplitude, frequency, and the phase shift can be set for each component when the HF2LI-MF Multi-frequency option is enabled.
The HF2LI provides 6 dual-phase demodulators. Each demodulator can be configured with its own filter properties including time constant from 1 μs to 500 s (corresponding to signal bandwidths from 80 μHz to 200 kHz) and filter order from 1st to 8th. The filters are implemented in advanced 128-bit digital architecture. The advantages over common analog instruments are higher dynamic reserve, zero drift, precise phase shifts, and orthogonality.
An integrated oscilloscope with memory for 2048 samples provides direct signal-vs-time and spectral views of the input signal. Users obtain an overview of the incoming and generated signals at any time to quickly find the right settings. A frequency response analyzer provides precise signal-vs-frequency plots. The FFT spectrum analyzer delivers a high-resolution spectral view of the signals demodulated by the lock-in amplifier.
Scan parameters Oscillator frequency, Demodulator phase shift, Auxiliary Offset, Signal Output Amplitudes, etc.


Featuring hosts Tuesday Miles and Angela Thomas, is the ultimate in paranomal radio shows. Aired weekly in markets around the world, P.O.R.T.A.L. is the UPRN 107.7 FM (New Orleans) and other fine radio stations worldwide as well as the online paranormal radio station for those who want to stay up to date with the latest events and topics within the paranormal field. Your personable hosts will guide you through an amazing journey of topics that include haunted houses, hauntings, ufo's, ghosts, spirits, and mediumship as well as other exciting and relevant information on paranormal research, paranormal events and paranormal investigations worldwide.
Guests of P.O.R.T.A.L. Paranormal Talk Radio include scholars and experts in the paranormal field offering insightful, first hand accounts of paranormal happenings and experiences. These highly esteemed guests are sure to educate you as well as entertain you.


text:
'The alliance emerged because of their relationship!' Shannan Ponton blasts Michelle Bridges and Steve 'Commando' Willis for collaboration between Biggest Loser teams
By Karishma Sarkari for Daily Mail Australia
Published: 06:44 EDT, 4 October 2015 | Updated: 10:44 EDT, 4 October 2015
It was a heated weigh in for The Biggest Loser teams on Sunday night's episode.
The Blue and White teams admitted to collaborating together after discovering Michelle Bridges's Red team had already formed an alliance with her partner Steve 'Commando' Willis's Black team during the week.
The news left The Pestells coach Shannan Ponton fuming, insinuating the alliance was more about the personal trainers' romance, not the benefit of their teams.
'The alliance emerged because of the relationship': Shannan Ponton slams Red and Black team trainers Michelle Bridges and Steve 'Commando' Willis for letting their romance affect their teams on TBL Families
'There's no doubt the alliance emerged because of the relationship between Commando and Michelle,' he said.
EXCLUSIVE: 'I don't feel the need to compare myself to her':... Boys club! The Bachelor Sam Wood celebrates Hawthorn AFL... 'Go the Wallabies!' Natalie Imbruglia dons the green and... Abs-solutely unreal! Rachael Finch showcases enviable...
However, Michelle refused to buy into it, tersely telling the other coaches: 'Alliances turn up in the house all the time, my job is to train my team and stay out of the politics.'
'The objective is to stay above the yellow line,' Commando added.
Tiffiny Hall, coach for White team The Hailwoods, tried to see the bright side and likened her now bigger group to a superteam.
'I stay out of the politics': Michelle defends herself in front of the other coaches and claims alliances in The Biggest Loser are common
Staying above the yellow line: Black team coach, Commando, reminded the other trainers the goal is to keep their teams safe from elimination and therefore above the yellow line
But the alliance was very short lived, when both the Blue and White teams found themselves under the all important yellow line and up for elimination, therefore not in a position to save each other.
'There's only one alliance in the house that matters, and that's the red and black team - we're the superteam,' the Black team's Johnee quipped proudly after the weigh in.
The team members got into some argy-bargy during the weigh in, when White team's Cliff spoke of the elephant in the room: 'The alliance between the red and black is getting stronger everyday, so we know we've gotta dig in deep'.
Silver lining: Tiffiny Hall (left) tried to up-sell their new team among the back and forth, while Shannan was just not impressed with their tactics
Firing back: Michelle and Commando weren't taking the criticism and fired back across the room
Slightly confused, Tony asked: 'Are you aligned with Blue though?'
Biting back, they admitted they were forced to collaborated with the remaining group following the Red and Black team coming together.
'That line was drawn when you voted Rina out,' Johnee jumped in, defending the honour of their team mate who was sent home the week before.
In the end, the Jofres ended up being the biggest losing family of the week, dropping a whopping 4.3 per cent total weight amongst the four of them, following a Protein rich seafood diet that gave them an advantage over the other teams.
Explaining the alliance: Tony (centre back) felt the need to explain how the Red team came to form an alliance in the house as accusations began to fly
'The line was drawn': While Johnee (left) told the other teams that Red and Black came together after Rina was voted off by the White and Blue
Laughable! The Pestell family didn't hesitate in getting involved in the argy-bargy
Playing it cool: While the Hailwoods kept their cool through the saga, which was all for nothing in the end as the Blue and White teams ended up facing off against each other
Meanwhile, the Hailwoods lost the least and wound up below the yellow line for the first time in the competition - scoring a 0.94 per cent loss.
This was in part thanks to a two kilogram weight penalty they were handed by the Red team following a challenge during the week.
Now, Kayla from the White team and Melissa from the Blue team will face off in the elimination.
TBL Families continues Monday, 7.30pm, Network Ten.
'There's only one superteam': The two teams were thrilled their strong alliance had worked and kept them out of the bottom two
Shannan Ponton blasts Michelle Bridges & Steve Willis for Biggest Loser alliance

redpajama_set_name: RedPajamaCommonCrawl


text:
Q: Can you passthrough a specific column in a scikit-learn ColumnTransformer? I have a fairly large datframe(300 columns) and I'm using sklearn to encode/scale some fields, I like that I can choose the specific columns I want and then it drop the rest. My problem is, now I have two numpy arrays in two columns in my large data frame that I would like passed through while the others I don't list in the sklearn pipeline are dropped.
For example:
from sklearn.preprocessing import LabelEncoder, OneHotEncoder
from sklearn.compose import ColumnTransformer
ct = ColumnTransformer([("Country", OneHotEncoder(), [1])], remainder = 'passthrough')

This would convert the country to onehot and pass through everything. What if I have a column called "numpy_array" how can I get that one only passed through?

A:
What if I have a column called "numpy_array" how can I get that one only passed through?

from sklearn.compose import ColumnTransformer

ct = ColumnTransformer(
    transformers=[
        ('np_array_transform', 'passthrough', ['numpy_array']),
    ],
    remainder='drop',
)