title: A Novel Approach for Neuromorphic Vision Data Compression based on Deep Belief Network

abstract: A neuromorphic camera is an image sensor that emulates the human eyes capturing only changes in local brightness levels. They are widely known as event cameras, silicon retinas or dynamic vision sensors (DVS). DVS records asynchronous per-pixel brightness changes, resulting in a stream of events that encode the brightness change's time, location, and polarity. DVS consumes little power and can capture a wider dynamic range with no motion blur and higher temporal resolution than conventional frame-based cameras. Although this method of event capture results in a lower bit rate than traditional video capture, it is further compressible. This paper proposes a novel deep learning-based compression scheme for event data. Using a deep belief network (DBN), the high dimensional event data is reduced into a latent representation and later encoded using an entropy-based coding technique. The proposed scheme is among the first to incorporate deep learning for event compression. It achieves a high compression ratio while maintaining good reconstruction quality outperforming state-of-the-art event data coders and other lossless benchmark techniques.


title: Block Codes on Pomset Metric

abstract: Given a regular multiset $M$ on $[n]=\{1,2,\ldots,n\}$, a partial order $R$ on $M$, and a label map $\pi : [n] \rightarrow \mathbb{N}$ defined by $\pi(i) = k_i$ with $\sum_{i=1}^{n}\pi (i) = N$, we define a pomset block metric $d_{(Pm,\pi)}$ on the direct sum $ \mathbb{Z}_{m}^{k_1} \oplus \mathbb{Z}_{m}^{k_2} \oplus \ldots \oplus \mathbb{Z}_{m}^{k_n}$ of $\mathbb{Z}_{m}^{N}$ based on the pomset $\mathbb{P}=(M,R)$. The pomset block metric extends the classical pomset metric introduced by I. G. Sudha and R. S. Selvaraj and generalizes the poset block metric introduced by M. M. S. Alves et al over $\mathbb{Z}_m$. The space $ (\mathbb{Z}_{m}^N,~d_{(Pm,\pi)} ) $ is called the pomset block space and we determine the complete weight distribution of it. Further, $I$-perfect pomset block codes for ideals with partial and full counts are described. Then, for block codes with chain pomset, the packing radius and Singleton bound are established. The relation between MDS codes and $I$-perfect codes for any ideal $I$ is investigated. Moreover, the duality theorem for an MDS pomset block code is established when all the blocks have the same size.


title: Explicit Intensity Control for Accented Text-to-speech

abstract: Accented text-to-speech (TTS) synthesis seeks to generate speech with an accent (L2) as a variant of the standard version (L1). How to control the intensity of accent in the process of TTS is a very interesting research direction, and has attracted more and more attention. Recent work design a speaker-adversarial loss to disentangle the speaker and accent information, and then adjust the loss weight to control the accent intensity. However, such a control method lacks interpretability, and there is no direct correlation between the controlling factor and natural accent intensity. To this end, this paper propose a new intuitive and explicit accent intensity control scheme for accented TTS. Specifically, we first extract the posterior probability, called as ``goodness of pronunciation (GoP)'' from the L1 speech recognition model to quantify the phoneme accent intensity for accented speech, then design a FastSpeech2 based TTS model, named Ai-TTS, to take the accent intensity expression into account during speech generation. Experiments show that the our method outperforms the baseline model in terms of accent rendering and intensity control.


title: Li3DeTr: A LiDAR based 3D Detection Transformer

abstract: Inspired by recent advances in vision transformers for object detection, we propose Li3DeTr, an end-to-end LiDAR based 3D Detection Transformer for autonomous driving, that inputs LiDAR point clouds and regresses 3D bounding boxes. The LiDAR local and global features are encoded using sparse convolution and multi-scale deformable attention respectively. In the decoder head, firstly, in the novel Li3DeTr cross-attention block, we link the LiDAR global features to 3D predictions leveraging the sparse set of object queries learnt from the data. Secondly, the object query interactions are formulated using multi-head self-attention. Finally, the decoder layer is repeated $L_{dec}$ number of times to refine the object queries. Inspired by DETR, we employ set-to-set loss to train the Li3DeTr network. Without bells and whistles, the Li3DeTr network achieves 61.3% mAP and 67.6% NDS surpassing the state-of-the-art methods with non-maximum suppression (NMS) on the nuScenes dataset and it also achieves competitive performance on the KITTI dataset. We also employ knowledge distillation (KD) using a teacher and student model that slightly improves the performance of our network.


title: Multi-dimensional Edge-based Audio Event Relational Graph Representation Learning for Acoustic Scene Classification

abstract: Most existing deep learning-based acoustic scene classification (ASC) approaches directly utilize representations extracted from spectrograms to identify target scenes. However, these approaches pay little attention to the audio events occurring in the scene despite they provide crucial semantic information. This paper conducts the first study that investigates whether real-life acoustic scenes can be reliably recognized based only on the features that describe a limited number of audio events. To model the task-specific relationships between coarse-grained acoustic scenes and fine-grained audio events, we propose an event relational graph representation learning (ERGL) framework for ASC. Specifically, ERGL learns a graph representation of an acoustic scene from the input audio, where the embedding of each event is treated as a node, while the relationship cues derived from each pair of event embeddings are described by a learned multidimensional edge feature. Experiments on a polyphonic acoustic scene dataset show that the proposed ERGL achieves competitive performance on ASC by using only a limited number of embeddings of audio events without any data augmentations. The validity of the proposed ERGL framework proves the feasibility of recognizing diverse acoustic scenes based on the event relational graph. Our code is available on our homepage (https://github.com/Yuanbo2020/ERGL).


title: Barbero--Immirzi--Holst Lagrangian with Spacetime Barbero--Immirzi Connections

abstract: We carry out the complete variational analysis of the Barbero--Immirzi--Holst Lagrangian, which is the Holst Lagrangian expressed in terms of the triad of fields $(\theta, A, \kappa)$, where $\theta$ is the solder form/spin frame, $A$ is the spacetime Barbero--Immirzi connection, and $\kappa$ is the extrinsic spacetime field. The Holst Lagrangian depends on the choice of a real, non zero Holst parameter $\gamma \neq 0$ and constitutes the classical field theory which is then quantized in Loop Quantum Gravity. The choice of a real Immirzi parameter $\beta$ sets up a one-to-one correspondence between pairs $(A, \kappa)$ and spin connections $\omega$ on spacetime. The variation of the Barbero--Immirzi--Holst Lagrangian is computed for an arbitrary pair of parameters $(\beta, \gamma)$. We develop and use the calculus of vector-valued differential forms to improve on the results already present in literature by better clarifying the geometric character of the resulting Euler--Lagrange equations. The main result is that the equations for $\theta$ are equivalent to the vacuum Einstein Field Equations, while the equations for $A$ and $\kappa$ give the same constraint equation for any $\beta \in \mathbb{R}$, namely that $A + \kappa$ must be the Levi--Civita connection induced by $\theta$. We also prove that these results are valid for any value of $\gamma \neq 0$, meaning that the choice of parameters $(\beta, \gamma)$ has no impact on the classical theory in a vacuum and, in particular, there is no need to set $\beta = \gamma$.


title: A Training and Inference Strategy Using Noisy and Enhanced Speech as Target for Speech Enhancement without Clean Speech

abstract: The lack of clean speech is a practical challenge to the development of speech enhancement systems, which means that there is an inevitable mismatch between their training criterion and evaluation metric. In response to this unfavorable situation, we propose a training and inference strategy that additionally uses enhanced speech as a target by improving the previously proposed noisy-target training (NyTT). Because homogeneity between in-domain noise and extraneous noise is the key to the effectiveness of NyTT, we train various student models by remixing 1) the teacher model's estimated speech and noise for enhanced-target training or 2) raw noisy speech and the teacher model's estimated noise for noisy-target training. Experimental results show that our proposed method outperforms several baselines, especially with the teacher/student inference, where predicted clean speech is derived successively through the teacher and final student models.


title: Effect of ambient gas on cavity formation for sphere impacts on liquids

abstract: Formation of a splash crown and a cavity following the impact of a sphere on a body of liquid is a classical problem. In the related problem of a droplet splashing on a flat surface, it has been established that the properties of the surrounding gas can influence the splashing threshold. At lower impact speeds, this is due mainly to the influence of gas kinetic effects, since the height of the gas lubrication film which is displaced during dynamic wetting is often comparable to the mean free path of the gas. At higher Weber and Reynolds numbers, on the other hand, inertial effects dominate and the density of the gas becomes important in determining whether a splash occurs. In this article, sphere impacts on a liquid body are investigated in a rarefied atmosphere using high-speed photography. It is found that the threshold entry speed for cavity formation is influenced by the density of the surrounding gas, whereas changing the mean free path of the gas has no effect. We attribute this phenomenon to the gas slowing the sealing of the thin crown sheet behind the sphere. This assertion is supported with experimental measurements of the liquid sheet thickness. In the range of parameters considered, the splash crown influences the movement of the contact line, an effect not previously observed.


title: CasNet: Investigating Channel Robustness for Speech Separation

abstract: Recording channel mismatch between training and testing conditions has been shown to be a serious problem for speech separation. This situation greatly reduces the separation performance, and cannot meet the requirement of daily use. In this study, inheriting the use of our previously constructed TAT-2mix corpus, we address the channel mismatch problem by proposing a channel-aware audio separation network (CasNet), a deep learning framework for end-to-end time-domain speech separation. CasNet is implemented on top of TasNet. Channel embedding (characterizing channel information in a mixture of multiple utterances) generated by Channel Encoder is introduced into the separation module by the FiLM technique. Through two training strategies, we explore two roles that channel embedding may play: 1) a real-life noise disturbance, making the model more robust, or 2) a guide, instructing the separation model to retain the desired channel information. Experimental results on TAT-2mix show that CasNet trained with both training strategies outperforms the TasNet baseline, which does not use channel embeddings.


title: Meta-Learning Initializations for Interactive Medical Image Registration

abstract: We present a meta-learning framework for interactive medical image registration. Our proposed framework comprises three components: a learning-based medical image registration algorithm, a form of user interaction that refines registration at inference, and a meta-learning protocol that learns a rapidly adaptable network initialization. This paper describes a specific algorithm that implements the registration, interaction and meta-learning protocol for our exemplar clinical application: registration of magnetic resonance (MR) imaging to interactively acquired, sparsely-sampled transrectal ultrasound (TRUS) images. Our approach obtains comparable registration error (4.26 mm) to the best-performing non-interactive learning-based 3D-to-3D method (3.97 mm) while requiring only a fraction of the data, and occurring in real-time during acquisition. Applying sparsely sampled data to non-interactive methods yields higher registration errors (6.26 mm), demonstrating the effectiveness of interactive MR-TRUS registration, which may be applied intraoperatively given the real-time nature of the adaptation process.


title: Effects of feedback on galaxies in the VELA simulations: elongation, clumps and compaction

abstract: The evolution of star-forming galaxies at high redshifts is very sensitive to the strength and nature of stellar feedback. Using two sets of cosmological, zoom-in simulations from the VELA suite, we compare the effects of two different models of feedback: with and without kinetic feedback from the expansion of supernovae shells and stellar winds. At a fixed halo mass and redshift, the stellar mass is reduced by a factor of 1-3 in the models with stronger feedback, so the stellar-mass-halo-mass relation is in better agreement with abundance matching results. On the other hand, the three-dimensional shape of low-mass galaxies is elongated along a major axis in both models. At a fixed stellar mass, Ms<10^10 Msun, galaxies are more elongated in the strong-feedback case. More massive, star-forming discs with high surface densities form giant clumps. However, the population of round, compact, old (age_c > 300 Myr), quenched, stellar (or gas-poor) clumps is absent in the model with strong feedback. On the other hand, giant star-forming clumps with intermediate ages (age_c= 100 - 300 Myr) can survive for several disc dynamical times, independently of feedback strength. The evolution through compaction followed by quenching in the plane of central surface density and specific star-formation rate is similar under the two feedback models.


title: Self-consistent Reasoning For Solving Math Word Problems

abstract: Math word problems (MWPs) is a task that automatically derives solution expression from a giving math problems in text. The previous studies suffer from spurious correlations between input text and output expression. To mitigate this issue, we propose a self-consistent reasoning framework called SCR, which attempts to adopt a pruning strategy to correct the output distribution shift so as to implicitly fix those spurious correlative samples. Specifically, we firstly obtain a sub-network by pruning a roberta2tree model, for the sake to use the gap on output distribution between the original roberta2tree model and the pruned sub-network to expose spurious correlative samples. Then, we calibrate the output distribution shift by applying symmetric Kullback-Leibler divergence to alleviate spurious correlations. In addition, SCR generates equivalent expressions, thereby, capturing the original text's logic rather than relying on hints from original text. Extensive experiments on two large-scale benchmarks demonstrate that our model substantially outperforms the strong baseline methods.


title: 2T-UNET: A Two-Tower UNet with Depth Clues for Robust Stereo Depth Estimation

abstract: Stereo correspondence matching is an essential part of the multi-step stereo depth estimation process. This paper revisits the depth estimation problem, avoiding the explicit stereo matching step using a simple two-tower convolutional neural network. The proposed algorithm is entitled as 2T-UNet. The idea behind 2T-UNet is to replace cost volume construction with twin convolution towers. These towers have an allowance for different weights between them. Additionally, the input for twin encoders in 2T-UNet are different compared to the existing stereo methods. Generally, a stereo network takes a right and left image pair as input to determine the scene geometry. However, in the 2T-UNet model, the right stereo image is taken as one input and the left stereo image along with its monocular depth clue information, is taken as the other input. Depth clues provide complementary suggestions that help enhance the quality of predicted scene geometry. The 2T-UNet surpasses state-of-the-art monocular and stereo depth estimation methods on the challenging Scene flow dataset, both quantitatively and qualitatively. The architecture performs incredibly well on complex natural scenes, highlighting its usefulness for various real-time applications. Pretrained weights and code will be made readily available.


title: Grasping Causality for the Explanation of Criticality for Automated Driving

abstract: The verification and validation of automated driving systems at SAE levels 4 and 5 is a multi-faceted challenge for which classical statistical considerations become infeasible. For this, contemporary approaches suggest a decomposition into scenario classes combined with statistical analysis thereof regarding the emergence of criticality. Unfortunately, these associational approaches may yield spurious inferences, or worse, fail to recognize the causalities leading to critical scenarios, which are, in turn, prerequisite for the development and safeguarding of automated driving systems. As to incorporate causal knowledge within these processes, this work introduces a formalization of causal queries whose answers facilitate a causal understanding of safety-relevant influencing factors for automated driving. This formalized causal knowledge can be used to specify and implement abstract safety principles that provably reduce the criticality associated with these influencing factors. Based on Judea Pearl's causal theory, we define a causal relation as a causal structure together with a context, both related to a domain ontology, where the focus lies on modeling the effect of such influencing factors on criticality as measured by a suitable metric. As to assess modeling quality, we suggest various quantities and evaluate them on a small example. As availability and quality of data are imperative for validly estimating answers to the causal queries, we also discuss requirements on real-world and synthetic data acquisition. We thereby contribute to establishing causal considerations at the heart of the safety processes that are urgently needed as to ensure the safe operation of automated driving systems.


title: Constraining the X-ray reflection in low accretion rate AGN using XMM-Newton, NuSTAR and Swift

abstract: An interesting feature in active galactic nuclei (AGN) accreting at low rate is the weakness of the reflection features in their X-ray spectra, which can result from the gradual disappearance of the torus with decreasing accretion rates. It has been suggested that low luminosity AGN (LLAGN) would have a different reflector configuration compared with high luminosity AGN, either covering a smaller fraction of the sky or simply having less material. Additionally, we note that the determination of the spectral index ($\Gamma$) and the cut-off energy of the primary power-law emission is affected by the inclusion of reflection models, showing the importance of using them to study the accretion mechanism, especially in the case of the LLAGN that have previously shown a high dispersion on the relation between $\Gamma$ and the accretion rate. Our purpose is to constrain the geometry and column density of the reflector in a sample of LLAGN covering a broad X-ray range of energy combining data from XMM-Newton + NuSTAR + Swift of a hard X-ray-flux limited sample of 17 LLAGN from BASS/DR2 with accretion rates $\lambda_{Edd}$=L$_{\rm Bol}$/L$_{\rm Edd}$<10$^{-3}$. We fit all spectra using the reflection model for torus (borus02) and accretion disk (Xillver) reflectors. We found a tentative correlation between the torus column density and the accretion rate, LLAGN shows a lower column density compared with the high-luminosity objects. We also confirm the relation between $\Gamma$ and $\lambda_{Edd}$, with a smaller scatter than previously reported, thanks to the inclusion of high-energy data and the reflection models. Our results are consistent with a break at $\lambda_{Edd}\sim10^{-3}$, suggestive of a different accretion mechanism compared with higher accretion AGN.


title: Retrieving Users' Opinions on Social Media with Multimodal Aspect-Based Sentiment Analysis

abstract: People post their opinions and experiences on social media, yielding rich databases of end-users' sentiments. This paper shows to what extent machine learning can analyze and structure these databases. An automated data analysis pipeline is deployed to provide insights into user-generated content for researchers in other domains. First, the domain expert can select an image and a term of interest. Then, the pipeline uses image retrieval to find all images showing similar content and applies aspect-based sentiment analysis to outline users' opinions about the selected term. As part of an interdisciplinary project between architecture and computer science researchers, an empirical study of Hamburg's Elbphilharmonie was conveyed. Therefore, we selected 300 thousand posts with the hashtag \enquote{\texttt{hamburg}} from the platform Flickr. Image retrieval methods generated a subset of slightly more than 1.5 thousand images displaying the Elbphilharmonie. We found that these posts mainly convey a neutral or positive sentiment towards it. With this pipeline, we suggest a new semantic computing method that offers novel insights into end-users opinions, e.g., for architecture domain experts.


title: Diffusion towards a nanoforest of absorbing pillars

abstract: Spiky coatings (also known as nanoforests or Fakir-like surfaces) have found many applications in chemical physics, material sciences and biotechnology, such as superhydrophobic materials, filtration and sensing systems, selective protein separation, to name but a few. In this paper, we provide a systematic study of steady-state diffusion towards a periodic array of absorbing cylindrical pillars protruding from a flat base. We approximate a periodic cell of this system by a circular tube containing a single pillar, derive an exact solution of the underlying Laplace equation, and deduce a simple yet exact representation for the total flux of particles onto the pillar. The dependence of this flux on the geometric parameters of the model is thoroughly analyzed. In particular, we investigate several asymptotic regimes such as a thin pillar limit, a disk-like pillar, and an infinitely long pillar. Our study sheds a light onto the trapping efficiency of spiky coatings and reveals the roles of pillar anisotropy and diffusional screening.

categories: physics.chem-ph cond-mat.stat-mech math-ph math.MP


title: MorphTE: Injecting Morphology in Tensorized Embeddings

abstract: In the era of deep learning, word embeddings are essential when dealing with text tasks. However, storing and accessing these embeddings requires a large amount of space. This is not conducive to the deployment of these models on resource-limited devices. Combining the powerful compression capability of tensor products, we propose a word embedding compression method with morphological augmentation, Morphologically-enhanced Tensorized Embeddings (MorphTE). A word consists of one or more morphemes, the smallest units that bear meaning or have a grammatical function. MorphTE represents a word embedding as an entangled form of its morpheme vectors via the tensor product, which injects prior semantic and grammatical knowledge into the learning of embeddings. Furthermore, the dimensionality of the morpheme vector and the number of morphemes are much smaller than those of words, which greatly reduces the parameters of the word embeddings. We conduct experiments on tasks such as machine translation and question answering. Experimental results on four translation datasets of different languages show that MorphTE can compress word embedding parameters by about 20 times without performance loss and significantly outperforms related embedding compression methods.


title: A distribution testing oracle separation between QMA and QCMA

abstract: It is a long-standing open question in quantum complexity theory whether the definition of $\textit{non-deterministic}$ quantum computation requires quantum witnesses $(\textsf{QMA})$ or if classical witnesses suffice $(\textsf{QCMA})$. We make progress on this question by constructing a randomized classical oracle separating the respective computational complexity classes. Previous separations [Aaronson-Kuperberg (CCC'07), Fefferman-Kimmel (MFCS'18)] required a quantum unitary oracle. The separating problem is deciding whether a distribution supported on regular un-directed graphs either consists of multiple connected components (yes instances) or consists of one expanding connected component (no instances) where the graph is given in an adjacency-list format by the oracle. Therefore, the oracle is a distribution over $n$-bit boolean functions.


title: Quantum multiparameter estimation with multi-mode photon catalysis entangled squeezed state

abstract: We propose a method to generate the multi-mode entangled catalysis squeezed vacuum states (MECSVS) by embedding the cross-Kerr nonlinear medium into the Mach-Zehnder interferometer. This method realizes the exchange of quantum states between different modes based on Fredkin gate. In addition, we study the MECSVS as the probe state of multi-arm optical interferometer to realize multi-phase simultaneous estimation. The results show that the quantum Cramer-Rao bound (QCRB) of phase estimation can be improved by increasing the number of catalytic photons or decreasing the transmissivity of the optical beam splitter using for photon catalysis. In addition, we also show that even if there is photon loss, the QCRB of our photon catalysis scheme is lower than that of the ideal entangled squeezed vacuum states (ESVS), which shows that by performing the photon catalytic operation is more robust against photon loss than that without the catalytic operation. The results here can find important applications in quantum metrology for multiparatmeter estimation.


title: Non-existence of mean-field models for particle orientations in suspensions

abstract: We consider a suspension of spherical inertialess particles in a Stokes flow on the torus $\mathbb T^3$. The particles perturb a linear extensional flow due to their rigidity constraint. Due to the singular nature of this perturbation, no mean-field limit for the behavior of the particle orientation can be valid. This contrasts with widely used models in the literature such as the FENE and Doi models and similar models for active suspensions. The proof of this result is based on the study of the mobility problem of a single particle in a non-cubic torus, which we prove to exhibit a nontrivial coupling between the angular velocity and a prescribed strain.


title: Search for the Chiral Magnetic Effect with charge-dependent azimuthal correlations in Xe-Xe collisions at $\sqrt{s_{\mathrm{NN}}} = 5.44$ TeV

abstract: Charge-dependent two- and three-particle correlations measured in Xe-Xe collisions at $\sqrt{s_{\mathrm{NN}}} = 5.44$ TeV are presented. Results are obtained for charged particles in the pseudorapidity range $|\eta|<0.8$ and transverse momentum interval $0.2 \le p_{\rm T}<5.0$ GeV/$c$ for different collision centralities. The three-particle correlator ${\gamma_{\alpha\beta}} \equiv {\langle \cos(\varphi_\alpha + \varphi_\beta - 2{\Psi_{\rm 2}}) \rangle}$, calculated for different combinations of charge sign $\alpha$ and $\beta$, is expected to be sensitive to the presence of the Chiral Magnetic Effect (CME). Its magnitude is similar to the one observed in Pb-Pb collisions in contrast to a smaller CME signal in Xe-Xe collisions than in Pb-Pb collisions predicted by Monte Carlo (MC) calculations including a magnetic field induced by the spectator protons. These observations point to a large non-CME contribution to the correlator. Furthermore, the charge dependence of ${\gamma_{\alpha\beta}}$ can be described by a blast wave model calculation that incorporates background effects and by the Anomalous Viscous Fluid Dynamics model with values of the CME signal consistent with zero. The Xe-Xe and Pb-Pb results are combined with the expected CME signal dependence on the system size from the MC calculations including a magnetic field to obtain the fraction of CME contribution in ${\gamma_{\alpha\beta}}$, $f_{\rm CME}$. The CME fraction is compatible with zero for the 30% most central events in both systems and then becomes positive; averaging over the 0-70% centrality interval yields an upper limit of 2% (3%) and 25% (32%) at 95% (99.7%) confidence level for the CME signal contribution to ${\gamma_{\alpha\beta}}$ in Xe-Xe and Pb-Pb collisions, respectively.


title: Machine Learning for RANS Turbulence Modelling of Variable Property Flows

abstract: This paper presents a machine learning methodology to improve the predictions of traditional RANS turbulence models in channel flows subject to strong variations in their thermophysical properties. The developed formulation contains several improvements over the existing Field Inversion Machine Learning (FIML) frameworks described in the literature, as well as the derivation of a new modelling technique. We first showcase the use of efficient optimization routines to automatize the process of field inversion in the context of CFD, combined with the use of symbolic algebra solvers to generate sparse-efficient algebraic formulas to comply with the discrete adjoint method. The proposed neural network architecture is characterized by the use of an initial layer of logarithmic neurons followed by hyperbolic tangent neurons, which proves numerically stable. The machine learning predictions are then corrected using a novel weighted relaxation factor methodology, that recovers valuable information from otherwise spurious predictions. The study uses the K-fold cross-validation technique, which is beneficial for small datasets. The results show that the machine learning model acts as an excellent non-linear interpolator for DNS cases well-represented in the training set, and that moderate improvement margins are obtained for sparser DNS cases. It is concluded that the developed machine learning methodology corresponds to a valid alternative to improve RANS turbulence models in flows with strong variations in their thermophysical properties without introducing prior modeling assumptions into the system.


title: Self-Supervised Training of Speaker Encoder with Multi-Modal Diverse Positive Pairs

abstract: We study a novel neural architecture and its training strategies of speaker encoder for speaker recognition without using any identity labels. The speaker encoder is trained to extract a fixed-size speaker embedding from a spoken utterance of various length. Contrastive learning is a typical self-supervised learning technique. However, the quality of the speaker encoder depends very much on the sampling strategy of positive and negative pairs. It is common that we sample a positive pair of segments from the same utterance. Unfortunately, such poor-man's positive pairs (PPP) lack necessary diversity for the training of a robust encoder. In this work, we propose a multi-modal contrastive learning technique with novel sampling strategies. By cross-referencing between speech and face data, we study a method that finds diverse positive pairs (DPP) for contrastive learning, thus improving the robustness of the speaker encoder. We train the speaker encoder on the VoxCeleb2 dataset without any speaker labels, and achieve an equal error rate (EER) of 2.89\%, 3.17\% and 6.27\% under the proposed progressive clustering strategy, and an EER of 1.44\%, 1.77\% and 3.27\% under the two-stage learning strategy with pseudo labels, on the three test sets of VoxCeleb1. This novel solution outperforms the state-of-the-art self-supervised learning methods by a large margin, at the same time, achieves comparable results with the supervised learning counterpart. We also evaluate our self-supervised learning technique on LRS2 and LRW datasets, where the speaker information is unknown. All experiments suggest that the proposed neural architecture and sampling strategies are robust across datasets.


title: Opening the Black Box of wav2vec Feature Encoder

abstract: Self-supervised models, namely, wav2vec and its variants, have shown promising results in various downstream tasks in the speech domain. However, their inner workings are poorly understood, calling for in-depth analyses on what the model learns. In this paper, we concentrate on the convolutional feature encoder where its latent space is often speculated to represent discrete acoustic units. To analyze the embedding space in a reductive manner, we feed the synthesized audio signals, which is the summation of simple sine waves. Through extensive experiments, we conclude that various information is embedded inside the feature encoder representations: (1) fundamental frequency, (2) formants, and (3) amplitude, packed with (4) sufficient temporal detail. Further, the information incorporated inside the latent representations is analogous to spectrograms but with a fundamental difference: latent representations construct a metric space so that closer representations imply acoustic similarity.


title: Automatic Severity Classification of Dysarthric speech by using Self-supervised Model with Multi-task Learning

abstract: Automatic assessment of dysarthric speech is essential for sustained treatments and rehabilitation. However, obtaining atypical speech is challenging, often leading to data scarcity issues. To tackle the problem, we propose a novel automatic severity assessment method for dysarthric speech, using the self-supervised model in conjunction with multi-task learning. Wav2vec 2.0 XLS-R is jointly trained for two different tasks: severity classification and auxiliary automatic speech recognition (ASR). For the baseline experiments, we employ hand-crafted acoustic features and machine learning classifiers such as SVM, MLP, and XGBoost. Explored on the Korean dysarthric speech QoLT database, our model outperforms the traditional baseline methods, with a relative percentage increase of 1.25% for F1-score. In addition, the proposed model surpasses the model trained without ASR head, achieving 10.61% relative percentage improvements. Furthermore, we present how multi-task learning affects the severity classification performance by analyzing the latent representations and regularization effect.


title: Flow of charge and heat in thermal QCD within the weak magnetic field limit: A BGK model approach

abstract: We have computed the charge and heat transport coefficients of hot QCD matter by solving the relativistic Boltzmann transport equation using the BGK model approximation with a modified collision integral in the weak magnetic field regime. This modified collision integral enhances both charge and heat transport phenomena which can be understood by the large values of the above-mentioned coefficients in comparison to the relaxation collision integral. We have also presented a comparative study of coefficients like the electrical conductivity ($\sigma_{el}$), Hall conductivity ($\sigma_{H}$), thermal conductivity ($\kappa$) and Hall-type thermal conductivity($\kappa_{H}$) in weak and strong magnetic fields in the BGK model approximation. The effects of weak magnetic field and finite chemical potential on the transport coefficients have been explored using a quasiparticle model. Moreover, we have also studied the effects of weak magnetic field and finite chemical potential on Lorenz number, Knudsen number, specific heat, elliptic flow and Wiedemann-Franz law.


title: Stability and related zero viscosity limit of steady plane Poiseuille-Couette flows with no-slip boundary condtion

abstract: We prove the existence and stability of smooth solutions to the steady Navier-Stokes equations near plane Poiseuille-Couette flow. Consequently, we also provide the zero viscosity limit of the 2D steady Navier-Stokes equations to the steady Euler equations. First, in the absence of any external force, we prove that there exist smooth solutions to the steady Navier-Stokes equations which are stable under infinitesimal perturbations of plane Poiseuille-Couette flow. In particular, if the basic flow is the Couette flow, then we can prove that the flow is stable for any finite perturbation small enough. Moreover, we also show that, if we put a proper external force to control the flow, then we can also obtain a large class of smooth solution of the steady Navier-Stokes equations which is stable for infinitesimal perturbation of the external force. Finally, based on the same linear estimates, we establish the zero viscosity limit of all the solutions obtained above to the solutions of the Euler equations.


title: A randomized multi-index sequential Monte Carlo method

abstract: We consider the problem of estimating expectations with respect to a target distribution with an unknown normalizing constant, and where even the unnormalized target needs to be approximated at finite resolution. Under such an assumption, this work builds upon a recently introduced multi-index Sequential Monte Carlo (SMC) ratio estimator, which provably enjoys the complexity improvements of multi-index Monte Carlo (MIMC) and the efficiency of SMC for inference. The present work leverages a randomization strategy to remove bias entirely, which simplifies estimation substantially, particularly in the MIMC context, where the choice of index set is otherwise important. Under reasonable assumptions, the proposed method provably achieves the same canonical complexity of MSE$^{-1}$ as the original method (where MSE is mean squared error), but without discretization bias. It is illustrated on examples of Bayesian inverse and spatial statistics problems.


title: On polyhomogeneous symbols and the Heisenberg pseudodifferential calculus

abstract: Polyhomogeneous symbols, defined by Kohn-Nirenberg and H\"ormander in the 60's, play a central role in the symbolic calculus of most pseudodifferential calculi. We prove a simple characterisation of polyhomogeneous functions which avoids the use of asymptotic expansions. Specifically, if $U$ is open subset of $\mathbb{R}^d$, then a polyhomogeneous symbol on $U \times \mathbb{R}^d$ is precisely the restriction to $t=1$ of a function on $U \times \mathbb{R}^{d+1}$ which is homogeneous for the dilations of $\mathbb{R}^{d+1}$ modulo Schwartz class functions. This result holds for arbitrary graded dilations on the vector space $\mathbb{R}^d$. As an application, using the generalisation of A.~Connes' tangent groupoid for a filtered manifold, we show that the Heisenberg calculus of Beals and Greiner on a contact manifold or a codimension 1 foliation coincides with the groupoid calculus of Van Erp and the second author.


title: LeNo: Adversarial Robust Salient Object Detection Networks with Learnable Noise

abstract: Pixel-wise prediction with deep neural network has become an effective paradigm for salient object detection (SOD) and achieved remarkable performance. However, very few SOD models are robust against adversarial attacks which are visually imperceptible for human visual attention. The previous work robust saliency (ROSA) shuffles the pre-segmented superpixels and then refines the coarse saliency map by the densely connected conditional random field (CRF). Different from ROSA that relies on various pre- and post-processings, this paper proposes a light-weight Learnable Noise (LeNo) to defend adversarial attacks for SOD models. LeNo preserves accuracy of SOD models on both adversarial and clean images, as well as inference speed. In general, LeNo consists of a simple shallow noise and noise estimation that embedded in the encoder and decoder of arbitrary SOD networks respectively. Inspired by the center prior of human visual attention mechanism, we initialize the shallow noise with a cross-shaped gaussian distribution for better defense against adversarial attacks. Instead of adding additional network components for post-processing, the proposed noise estimation modifies only one channel of the decoder. With the deeply-supervised noise-decoupled training on state-of-the-art RGB and RGB-D SOD networks, LeNo outperforms previous works not only on adversarial images but also on clean images, which contributes stronger robustness for SOD. Our code is available at https://github.com/ssecv/LeNo.


title: Efficient Learning of Decision-Making Models: A Penalty Block Coordinate Descent Algorithm for Data-Driven Inverse Optimization

abstract: Decision-making problems are commonly formulated as optimization problems, which are then solved to make optimal decisions. In this work, we consider the inverse problem where we use prior decision data to uncover the underlying decision-making process in the form of a mathematical optimization model. This statistical learning problem is referred to as data-driven inverse optimization. We focus on problems where the underlying decision-making process is modeled as a convex optimization problem whose parameters are unknown. We formulate the inverse optimization problem as a bilevel program and propose an efficient block coordinate descent-based algorithm to solve large problem instances. Numerical experiments on synthetic datasets demonstrate the computational advantage of our method compared to standard commercial solvers. Moreover, the real-world utility of the proposed approach is highlighted through two realistic case studies in which we consider estimating risk preferences and learning local constraint parameters of agents in a multiplayer Nash bargaining game.


title: Cumulants from short-range correlations and baryon number conservation - next-to-leading order

abstract: We calculate the baryon number cumulants within acceptance with short-range correlations and global baryon number conservation in terms of cumulants in the whole system without baryon conservation. We extract leading and next-to-leading order terms of the large baryon number limit approximation. Our results extend the findings of Refs. [1,2]. These approximations are checked to be very close to the exact results.


title: Querying Incomplete Numerical Data: Between Certain and Possible Answers

abstract: Queries with aggregation and arithmetic operations, as well as incomplete data, are common in real-world database, but we lack a good understanding of how they should interact. On the one hand, systems based on SQL provide ad-hoc rules for numerical nulls, on the other, theoretical research largely concentrates on the standard notions of certain and possible answers. In the presence of numerical attributes and aggregates, however, these answers are often meaningless, returning either too little or too much. Our goal is to define a principled framework for databases with numerical nulls and answering queries with arithmetic and aggregations over them. Towards this goal, we assume that missing values in numerical attributes are given by probability distributions associated with marked nulls. This yields a model of probabilistic bag databases in which tuples are not necessarily independent, since nulls can repeat. We provide a general compositional framework for query answering, and then concentrate on queries that resemble standard SQL with arithmetic and aggregation. We show that these queries are measurable, and that their outputs have a finite representation. Moreover, since the classical forms of answers provide little information in the numerical setting, we look at the probability that numerical values in output tuples belong to specific intervals. Even though their exact computation is intractable, we show efficient approximation algorithms to compute such probabilities.


title: Quantum security of subset cover problems

abstract: The subset cover problem for $k \geq 1$ hash functions, which can be seen as an extension of the collision problem, was introduced in 2002 by Reyzin and Reyzin to analyse the security of their hash-function based signature scheme HORS. The security of many hash-based signature schemes relies on this problem or a variant of this problem (e.g. HORS, SPHINCS, SPHINCS+, $\dots$). Recently, Yuan, Tibouchi and Abe (2022) introduced a variant to the subset cover problem, called restricted subset cover, and proposed a quantum algorithm for this problem. In this work, we prove that any quantum algorithm needs to make $\Omega\left((k+1)^{-\frac{2^{k}}{2^{k+1}-1}}\cdot N^{\frac{2^{k}-1}{2^{k+1}-1}}\right)$ queries to the underlying hash functions with codomain size $N$ to solve the restricted subset cover problem, which essentially matches the query complexity of the algorithm proposed by Yuan, Tibouchi and Abe. We also analyze the security of the general $(r,k)$-subset cover problem, which is the underlying problem that implies the unforgeability of HORS under a $r$-chosen message attack (for $r \geq 1$). We prove that a generic quantum algorithm needs to make $\Omega\left(N^{k/5}\right)$ queries to the underlying hash functions to find a $(1,k)$-subset cover. We also propose a quantum algorithm that finds a $(r,k)$-subset cover making $O\left(N^{k/(2+2r)}\right)$ queries to the $k$ hash functions.


title: Pseudolocality theorems of Ricci flows on incomplete manifolds

abstract: In this paper we study the pseudolocality theorems of Ricci flows on incomplete manifolds. We prove that if a ball with its closure contained in an incomplete manifold has the small scalar curvature lower bound and almost Euclidean isoperimetric constant, or almost Euclidean local $\boldsymbol{\nu}$ constant, then we can construct a solution of Ricci flow in the ball which have the pseudolocality property. We also give two applications. First, we prove the short-time existence of Ricci flows on complete manifolds with scalar curvature bounded below uniformly and almost Euclidean isoperimetric inequality holds locally. Second, we show that any complete manifold with nonnegative scalar curvature and Euclidean isoperimetric inequality must be isometric to the Euclidean space.


title: Make More of Your Data: Minimal Effort Data Augmentation for Automatic Speech Recognition and Translation

abstract: Data augmentation is a technique to generate new training data based on existing data. We evaluate the simple and cost-effective method of concatenating the original data examples to build new training instances. Continued training with such augmented data is able to improve off-the-shelf Transformer and Conformer models that were optimized on the original data only. We demonstrate considerable improvements on the LibriSpeech-960h test sets (WER 2.83 and 6.87 for test-clean and test-other), which carry over to models combined with shallow fusion (WER 2.55 and 6.27). Our method of continued training also leads to improvements of up to 0.9 WER on the ASR part of CoVoST-2 for four non English languages, and we observe that the gains are highly dependent on the size of the original training data. We compare different concatenation strategies and found that our method does not need speaker information to achieve its improvements. Finally, we demonstrate on two datasets that our methods also works for speech translation tasks.


title: Joint Communication and Computation Design in Transmissive RMS Transceiver Enabled Multi-Tier Computing Networks

abstract: In this paper, a novel transmissive reconfigurable meta-surface (RMS) transceiver enabled multi-tier computing network architecture is proposed for improving computing capability, decreasing computing delay and reducing base station (BS) deployment cost, in which transmissive RMS equipped with a feed antenna can be regarded as a new type of multi-antenna system. We formulate a total energy consumption minimization problem by a joint optimization of subcarrier allocation, task input bits, time slot allocation, transmit power allocation and RMS transmissive coefficient while taking into account the constraints of communication resources and computing resources. This formulated problem is a non-convex optimization problem due to the high coupling of optimization variables, which is NP-hard to obtain its optimal solution. To address the above challenging problems, block coordinate descent (BCD) technique is employed to decouple the optimization variables to solve the problem. Specifically, the joint optimization problem of subcarrier allocation, task input bits, time slot allocation, transmit power allocation and RMS transmissive coefficient is divided into three subproblems to solve by applying BCD. Then, the decoupled three subproblems are optimized alternately by using successive convex approximation (SCA) and difference-convex (DC) programming until the convergence is achieved. Numerical results verify that our proposed algorithm is superior in reducing total energy consumption compared to other benchmarks.


title: EmulART: Emulating Radiative Transfer -- A pilot study on autoencoder based dimensionality reduction for radiative transfer models

abstract: Dust is a major component of the interstellar medium. Through scattering, absorption and thermal re-emission, it can profoundly alter astrophysical observations. Models for dust composition and distribution are necessary to better understand and curb their impact on observations. A new approach for serial and computationally inexpensive production of such models is here presented. Traditionally these models are studied with the help of radiative transfer modelling, a critical tool to understand the impact of dust attenuation and reddening on the observed properties of galaxies and active galactic nuclei. Such simulations present, however, an approximately linear computational cost increase with the desired information resolution. Our new efficient model generator proposes a denoising variational autoencoder (or alternatively PCA), for spectral compression, combined with an approximate Bayesian method for spatial inference, to emulate high information radiative transfer models from low information models. For a simple spherical dust shell model with anisotropic illumination, our proposed approach successfully emulates the reference simulation starting from less than 1% of the information. Our emulations of the model at different viewing angles present median residuals below 15% across the spectral dimension, and below 48% across spatial and spectral dimensions. EmulART infers estimates for ~85% of information missing from the input, all within a total running time of around 20 minutes, estimated to be 6x faster than the present target high information resolution simulations, and up to 50x faster when applied to more complicated simulations.


title: Facial Video-based Remote Physiological Measurement via Self-supervised Learning

abstract: Facial video-based remote physiological measurement aims to estimate remote photoplethysmography (rPPG) signals from human face videos and then measure multiple vital signs (e.g. heart rate, respiration frequency) from rPPG signals. Recent approaches achieve it by training deep neural networks, which normally require abundant facial videos and synchronously recorded photoplethysmography (PPG) signals for supervision. However, the collection of these annotated corpora is not easy in practice. In this paper, we introduce a novel frequency-inspired self-supervised framework that learns to estimate rPPG signals from facial videos without the need of ground truth PPG signals. Given a video sample, we first augment it into multiple positive/negative samples which contain similar/dissimilar signal frequencies to the original one. Specifically, positive samples are generated using spatial augmentation. Negative samples are generated via a learnable frequency augmentation module, which performs non-linear signal frequency transformation on the input without excessively changing its visual appearance. Next, we introduce a local rPPG expert aggregation module to estimate rPPG signals from augmented samples. It encodes complementary pulsation information from different face regions and aggregate them into one rPPG prediction. Finally, we propose a series of frequency-inspired losses, i.e. frequency contrastive loss, frequency ratio consistency loss, and cross-video frequency agreement loss, for the optimization of estimated rPPG signals from multiple augmented video samples and across temporally neighboring video samples. We conduct rPPG-based heart rate, heart rate variability and respiration frequency estimation on four standard benchmarks. The experimental results demonstrate that our method improves the state of the art by a large margin.


title: Bounds on oblivious multiparty quantum communication complexity

abstract: The main conceptual contribution of this paper is investigating quantum multiparty communication complexity in the setting where communication is \emph{oblivious}. This requirement, which to our knowledge is satisfied by all quantum multiparty protocols in the literature, means that the communication pattern, and in particular the amount of communication exchanged between each pair of players at each round is fixed \emph{independently of the input} before the execution of the protocol. We show, for a wide class of functions, how to prove strong lower bounds on their oblivious quantum $k$-party communication complexity using lower bounds on their \emph{two-party} communication complexity. We apply this technique to prove tight lower bounds for all symmetric functions with \textsf{AND} gadget, and in particular obtain an optimal $\Omega(k\sqrt{n})$ lower bound on the oblivious quantum $k$-party communication complexity of the $n$-bit Set-Disjointness function. We also show the tightness of these lower bounds by giving (nearly) matching upper bounds.


title: Morita equivalence and globalization for partial Hopf actions on nonunital algebras

abstract: In this work we investigate partial actions of a Hopf algebra H on nonunital algebras and the associated partial smash products. We show that our partial actions correspond to nonunital algebras in the category of partial representations of H. The central problem of existence of a globalization for a partial action is studied in detail, and we provide sufficient conditions for the existence (and uniqueness) of a minimal globalization for associative algebras in general. Extending previous results by Abadie, Dokuchaev, Exel and Simon, we define Morita equivalence for partial Hopf actions, and we show that if two symmetrical partial actions are Morita equivalent then their standard globalizations are also Morita equivalent. Particularizing to the case of a partial action on an algebra with local units, we obtain several strong results on equivalences of categories of modules of partial smash products of algebras and partial smash products of k-categories.


title: Nonequilibrium Green's function approach to multi-band Cooper-pair transport: linear magnetoresistance effect due to nonunitary superconductivity

abstract: Many-body transport has emerged as an efficient tool for understanding interaction effects in quantum materials with a multi-band electronic structure. This paper proposes a formula for the two-particle transmission coefficient for Cooper-pair transport between multi-band normal and superconducting materials. The approach employs a tight-binding nonequilibrium Green's function technique, allowing a direct calculation of the two-particle current, without invoking the paradigm of Andreev reflection. As an application of the theory, we demonstrate a low-field linear magnetoresistance effect for superconductors with an induced nonunitary order parameter. These results uncover an unexplored route for detecting unconventional nonunitary superconductivity in quantum materials of current theoretical and experimental interest.


title: The optimal displacement of immiscible two-phase fluids in a pore doublet

abstract: The displacement of multiphase fluid flow in a pore doublet is a fundamental problem, and is also of importance in understanding of the transport mechanisms of multiphase flows in the porous media. During the displacement of immiscible two-phase fluids in the pore doublet, the transport process is not only influenced by the capillary and viscous forces, but also affected by the channel geometry. In this paper, we first present a mathematical model to describe the two-phase fluid displacement in the pore doublet where the effects of capillary force, viscous force and the geometric structure are included. Then we derive an analytical solution of the model for the first time, and find that the displacement process is dominated by the capillary number, the viscosity ratio and the radius ratio. Furthermore, we define the optimal displacement that the wetting fluids in two daughter channels break through the branches simultaneously (both of them have the same breakthrough time), and also obtain the critical capillary number corresponding to the optimal displacement, which is related to the radius ratio of two daughter channels and viscosity ratio of two immiscible fluids. Finally, it is worthy noting that the present analytical results on the displacement in the pore doublet can be used to explain and understand the phenomenon of preferential imbibition or preferential flow in porous media.


title: Lupascian Non-Negativity Applied to Conceptual Modeling: Alternating Static Potentiality and Dynamic Actuality

abstract: In software engineering, conceptual modeling focuses on creating representations of the world that are as faithful and rich as possible, with the aim of guiding the development of software systems. In contrast, in the computing realm, the notion of ontology has been characterized as being closely related to conceptual modeling and is often viewed as a specification of a conceptualization. Accordingly, conceptual modeling and ontology engineering now address the same problem of representing the world in a suitable fashion. A high-level ontology provides a means to describe concepts and their interactions with each other and to capture structural and behavioral features in the intended domain. This paper aims to analyze ontological concepts and semantics of modeling notations to provide a common understanding among software engineers. An important issue in this context concerns the question of whether the modeled world might be stratified into ontological levels. We introduce an abstract system of two-level domain ontology to be used as a foundation for conceptual models. We study the two levels of staticity and dynamics in the context of the thinging machine (TM) model using the notions of potentiality and actuality that the Franco-Romanian philosopher Stephane Lupasco developed in logic. He provided a quasi-universal rejection of contradiction where every event was always associated with a no event, such that the actualization of an event entails the potentialization of a no event and vice versa without either ever disappearing completely. This approach is illustrated by re-modeling UML state machines in TM modeling. The results strengthen the semantics of a static versus dynamic levels in conceptual modeling and sharpen the notion of events as a phenomenon without negativity alternating between the two levels of dynamics and staticity.


title: Model Order Selection with Variational Autoencoding

abstract: Classical methods for model order selection often fail in scenarios with low SNR or few snapshots. Deep learning-based methods are promising alternatives for such challenging situations as they compensate lack of information in the available observations with training on large datasets. This manuscript proposes an approach that uses a variational autoencoder (VAE) for model order selection. The idea is to learn a parameterized conditional covariance matrix at the VAE decoder that approximates the true signal covariance matrix. The method is unsupervised and only requires a small representative dataset for calibration after training the VAE. Numerical simulations show that the proposed method outperforms classical methods and even reaches or beats a supervised approach depending on the considered snapshots.


title: Quantum-geometric contribution to the Bogoliubov modes in a two-band Bose-Einstein condensate

abstract: We consider a weakly-interacting Bose-Einstein condensate (BEC) that is loaded into an optical lattice with a two-point basis, and described by a two-band Bose-Hubbard model with generic one-body and two-body terms. By first projecting the system to the lower Bloch band and then applying the Bogoliubov approximation to the resultant Hamiltonian, we show that the inverse effective-mass tensor of the superfluid carriers in the Bogoliubov spectrum has two physically distinct contributions. In addition to the usual inverse band-mass tensor that is originating from the intraband processes within the lower Bloch band, there is also a quantum-geometric contribution that is induced by the two-body interactions through the interband processes. We also discuss the conditions under which the latter contribution is expressed in terms of the quantum-metric tensor of the Bloch states, i.e., the natural Fubini-Study metric on the Bloch sphere.


title: Constrained Differential Dynamic Programming: A primal-dual augmented Lagrangian approach

abstract: Trajectory optimization is an efficient approach for solving optimal control problems for complex robotic systems. It relies on two key components: first the transcription into a sparse nonlinear program, and second the corresponding solver to iteratively compute its solution. On one hand, differential dynamic programming (DDP) provides an efficient approach to transcribe the optimal control problem into a finite-dimensional problem while optimally exploiting the sparsity induced by time. On the other hand, augmented Lagrangian methods make it possible to formulate efficient algorithms with advanced constraint-satisfaction strategies. In this paper, we propose to combine these two approaches into an efficient optimal control algorithm accepting both equality and inequality constraints. Based on the augmented Lagrangian literature, we first derive a generic primal-dual augmented Lagrangian strategy for nonlinear problems with equality and inequality constraints. We then apply it to the dynamic programming principle to solve the value-greedy optimization problems inherent to the backward pass of DDP, which we combine with a dedicated globalization strategy, resulting in a Newton-like algorithm for solving constrained trajectory optimization problems. Contrary to previous attempts of formulating an augmented Lagrangian version of DDP, our approach exhibits adequate convergence properties without any switch in strategies. We empirically demonstrate its interest with several case-studies from the robotics literature.


title: Bayesian Inference of Transition Matrices from Incomplete Graph Data with a Topological Prior

abstract: Many network analysis and graph learning techniques are based on models of random walks which require to infer transition matrices that formalize the underlying stochastic process in an observed graph. For weighted graphs, it is common to estimate the entries of such transition matrices based on the relative weights of edges. However, we are often confronted with incomplete data, which turns the construction of the transition matrix based on a weighted graph into an inference problem. Moreover, we often have access to additional information, which capture topological constraints of the system, i.e. which edges in a weighted graph are (theoretically) possible and which are not, e.g. transportation networks, where we have access to passenger trajectories as well as the physical topology of connections, or a set of social interactions with the underlying social structure. Combining these two different sources of information to infer transition matrices is an open challenge, with implications on the downstream network analysis tasks. Addressing this issue, we show that including knowledge on such topological constraints can improve the inference of transition matrices, especially for small datasets. We derive an analytically tractable Bayesian method that uses repeated interactions and a topological prior to infer transition matrices data-efficiently. We compare it against commonly used frequentist and Bayesian approaches both in synthetic and real-world datasets, and we find that it recovers the transition probabilities with higher accuracy and that it is robust even in cases when the knowledge of the topological constraint is partial. Lastly, we show that this higher accuracy improves the results for downstream network analysis tasks like cluster detection and node ranking, which highlights the practical relevance of our method for analyses of various networked systems.


title: A Type of Unifying Relation in (A)dS Spacetime

abstract: Unifying relations of amplitudes are elegant results in flat spacetime, but the research on these in (A)dS case is not very rich. In this paper, we discuss a type of unifying relations in (A)dS by using Berends-Giele currents. By taking the flat limit, we also get a semi-on-shell way to prove the unifying relations in the flat case. We also discuss the applications of our results in cosmology.


title: Assessing the Quality of QM/MM Approaches to Describe Vacuo-to-water Solvatochromic Shifts

abstract: The performance of different Quantum Mechanics/Molecular Mechanics embedding models to compute vacuo-to-water solvatochromic shifts are investigated. In particular, both non-polarizable and polarizable approaches are analyzed and computed results as compared to reference experimental data. We show that none of the approaches outperforms the others and that errors strongly depend on the nature of the molecular transition. Thus, we prove that the best choice of embedding model highly depends on the molecular system, and that the use a specific approach as a black-box can lead to significant errors and sometimes totally wrong predictions.


title: Search for pair-production of vector-like quarks in $pp$ collision events at $\sqrt{s}=13$ TeV with at least one leptonically decaying $Z$ boson and a third-generation quark with the ATLAS detector

abstract: A search for the pair-production of vector-like quarks optimized for decays into a $Z$ boson and a third-generation Standard Model quark is presented, using the full Run 2 dataset corresponding to 139 fb$^{-1}$ of $pp$ collisions at $\sqrt{s}=13$ TeV, collected in 2015-2018 with the ATLAS detector at the Large Hadron Collider. The targeted final state is characterized by the presence of a $Z$ boson with high transverse momentum, reconstructed from a pair of same-flavour leptons with opposite-sign charges, as well as by the presence of $b$-tagged jets and high-transverse-momentum large-radius jets reconstructed from calibrated smaller-radius jets. Events with exactly two or at least three leptons are used, which are further categorized by the presence of boosted $W$, $Z$, and Higgs bosons and top quarks. The categorization is performed using a neural-network-based boosted object tagger to enhance the sensitivity to signal relative to the background. No significant excess above the background expectation is observed and exclusion limits at 95% confidence level are set on the masses of the vector-like partners $T$ and $B$ of the top and bottom quarks, respectively. In the singlet model, the limits allow $m_T > 1.27$ TeV and $m_B > 1.20$ TeV. In the doublet model, allowed masses are $m_T > 1.46$ TeV and $m_B >1.32$ TeV. In the case of 100% branching ratio for $T\rightarrow Zt$ and 100% branching ratio for $B\rightarrow Zb$, the limits allow $m_T > 1.60$ TeV and $m_B > 1.42$ TeV, respectively.


title: Local Graph-homomorphic Processing for Privatized Distributed Systems

abstract: We study the generation of dependent random numbers in a distributed fashion in order to enable privatized distributed learning by networked agents. We propose a method that we refer to as local graph-homomorphic processing; it relies on the construction of particular noises over the edges to ensure a certain level of differential privacy. We show that the added noise does not affect the performance of the learned model. This is a significant improvement to previous works on differential privacy for distributed algorithms, where the noise was added in a less structured manner without respecting the graph topology and has often led to performance deterioration. We illustrate the theoretical results by considering a linear regression problem over a network of agents.


title: Exact Gradient Computation for Spiking Neural Networks Through Forward Propagation

abstract: Spiking neural networks (SNN) have recently emerged as alternatives to traditional neural networks, owing to energy efficiency benefits and capacity to better capture biological neuronal mechanisms. However, the classic backpropagation algorithm for training traditional networks has been notoriously difficult to apply to SNN due to the hard-thresholding and discontinuities at spike times. Therefore, a large majority of prior work believes exact gradients for SNN w.r.t. their weights do not exist and has focused on approximation methods to produce surrogate gradients. In this paper, (1) by applying the implicit function theorem to SNN at the discrete spike times, we prove that, albeit being non-differentiable in time, SNNs have well-defined gradients w.r.t. their weights, and (2) we propose a novel training algorithm, called \emph{forward propagation} (FP), that computes exact gradients for SNN. FP exploits the causality structure between the spikes and allows us to parallelize computation forward in time. It can be used with other algorithms that simulate the forward pass, and it also provides insights on why other related algorithms such as Hebbian learning and also recently-proposed surrogate gradient methods may perform well.


title: A theoretical model for tellurite-sulfates Na$_2$Cu$_5$(TeO$_3$)(SO$_4$)$_3$(OH)$_4$ and K$_2$Cu$_5$(TeO$_3$)(SO$_4$)$_3$(OH)$_4$

abstract: A theoretical model for two new tellurite-sulfates, namely Na$_2$Cu$_5$(TeO$_3$)(SO$_4$)$_3$(OH)$_4$ and K$_2$Cu$_5$(TeO$_3$)(SO$_4$)$_3$ (OH)$_4$ is determined to be compatible with ab-initio calculations. The results obtained in this work show that some previous speculations in the literature about the couplings are correct, obtaining a model with a mixture of ferromagnetic and antiferromagnetic couplings. We use a combination of numerical techniques to study the magnetic properties of the model. Our numerical calculations based on the density-matrix renormalization group method reveal that the system presents Ising-like magnetization plateaux at rational values of the saturation magnetization.


title: Dynamic Survival Transformers for Causal Inference with Electronic Health Records

abstract: In medicine, researchers often seek to infer the effects of a given treatment on patients' outcomes. However, the standard methods for causal survival analysis make simplistic assumptions about the data-generating process and cannot capture complex interactions among patient covariates. We introduce the Dynamic Survival Transformer (DynST), a deep survival model that trains on electronic health records (EHRs). Unlike previous transformers used in survival analysis, DynST can make use of time-varying information to predict evolving survival probabilities. We derive a semi-synthetic EHR dataset from MIMIC-III to show that DynST can accurately estimate the causal effect of a treatment intervention on restricted mean survival time (RMST). We demonstrate that DynST achieves better predictive and causal estimation than two alternative models.


title: FreeVC: Towards High-Quality Text-Free One-Shot Voice Conversion

abstract: Voice conversion (VC) can be achieved by first extracting source content information and target speaker information, and then reconstructing waveform with these information. However, current approaches normally either extract dirty content information with speaker information leaked in, or demand a large amount of annotated data for training. Besides, the quality of reconstructed waveform can be degraded by the mismatch between conversion model and vocoder. In this paper, we adopt the end-to-end framework of VITS for high-quality waveform reconstruction, and propose strategies for clean content information extraction without text annotation. We disentangle content information by imposing an information bottleneck to WavLM features, and propose the spectrogram-resize based data augmentation to improve the purity of extracted content information. Experimental results show that the proposed method outperforms the latest VC models trained with annotated data and has greater robustness.


title: Action Functional Gradient Descent algorithm for estimating escape paths in Stochastic Chemical Reaction Networks

abstract: We first derive the Hamilton-Jacobi theory underlying continuous-time Markov processes, and then use the construction to develop a variational algorithm for estimating escape (least improbable or first passage) paths for a generic stochastic chemical reaction network that exhibits multiple fixed points. The design of our algorithm is such that it is independent of the underlying dimensionality of the system, the discretization control parameters are updated towards the continuum limit, and there is an easy-to-calculate measure for the correctness of its solution. We consider several applications of the algorithm and verify them against computationally expensive means such as the shooting method and stochastic simulation. While we employ theoretical techniques from mathematical physics, numerical optimization and chemical reaction network theory, we hope that our work finds practical applications with an inter-disciplinary audience including chemists, biologists, optimal control theorists and game theorists.


title: Model of block media taking into account internal friction

abstract: The block medium is modeled by a discrete-periodic spatial lattice of masses connected by elastic springs and viscous dampers. To describe the viscoelastic behavior of the interblock layers, a rheological model of internal friction with two Maxwell elements and one Voigt element with the quality factor of the material as the determining parameter is proposed. Numerical experiments show that, within the framework of this interlayer model, it is possible to select the viscosity and stiffness of the Maxwell and Voigt elements so that the quality factor of the material differs from the given constant value by no more than 5%. In the one-dimensional case, within the framework of the proposed model, the influence of the quality factor on the dispersion properties of a block medium is studied and it is shown that the greatest effect of the quality factor on the dispersion is observed in the low-frequency part of the spectrum. In the three-dimensional case, within the framework of the proposed model, some geomechanical problems are numerically studied for a block half-space under the action of a surface concentrated vertical load. Namely, the attenuation of the velocity amplitudes of surface blocks was studied depending on the Q-factor under step action and under the action of a Gaussian pulse. In addition, we study a layer on the surface of a half-space under the action of a concentrated vertical impulse load in the case when both the layer and the half-space are block media but have different properties.


title: AnyDijkstra, an algorithm to compute shortest paths on images with anytime properties

abstract: Images conveniently capture the result of physical processes, representing rich source of information for data driven medicine, engineering, and science. The modeling of an image as a graph allows the application of graph-based algorithms for content analysis. Amongst these, one of the most used is the Dijkstra Single Source Shortest Path algorithm (DSSSP), which computes the path with minimal cost from one starting node to all the other nodes of the graph. However, the results of DSSSP remains unknown for nodes until they are explored. Moreover, DSSSP execution is associated to frequent jumps between distant locations in the graph, which results in non-optimal memory access, reduced parallelization, and finally increased execution time. Therefore, we propose AnyDijkstra, an iterative implementation of the Dijkstra SSSP algorithm optimized for images, that retains anytime properties while accessing memory following a cache-friendly scheme and maximizing parallelization.


title: Supervised classification methods applied to airborne hyperspectral images: Comparative study using mutual information

abstract: Nowadays, the hyperspectral remote sensing imagery HSI becomes an important tool to observe the Earth's surface, detect the climatic changes and many other applications. The classification of HSI is one of the most challenging tasks due to the large amount of spectral information and the presence of redundant and irrelevant bands. Although great progresses have been made on classification techniques, few studies have been done to provide practical guidelines to determine the appropriate classifier for HSI. In this paper, we investigate the performance of four supervised learning algorithms, namely, Support Vector Machines SVM, Random Forest RF, K-Nearest Neighbors KNN and Linear Discriminant Analysis LDA with different kernels in terms of classification accuracies. The experiments have been performed on three real hyperspectral datasets taken from the NASA's Airborne Visible/Infrared Imaging Spectrometer Sensor AVIRIS and the Reflective Optics System Imaging Spectrometer ROSIS sensors. The mutual information had been used to reduce the dimensionality of the used datasets for better classification efficiency. The extensive experiments demonstrate that the SVM classifier with RBF kernel and RF produced statistically better results and seems to be respectively the more suitable as supervised classifiers for the hyperspectral remote sensing images. Keywords: hyperspectral images, mutual information, dimension reduction, Support Vector Machines, K-Nearest Neighbors, Random Forest, Linear Discriminant Analysis.


title: Transversal generalizations of hyperplane equipartitions

abstract: The classical Ham Sandwich theorem states that any $d$ point sets in $\mathbb{R}^d$ can be simultaneously bisected by a single affine hyperplane. A generalization of Dolnikov asserts that any $d$ families of pairwise intersecting compact, convex sets in $\mathbb{R}^d$ admit a common hyperplane transversal. We extend Dolnikov's theorem by showing that families of compact convex sets satisfying more general non-disjointness conditions admit common transversals by multiple hyperplanes. In particular, these generalize all known optimal results to the long-standing Gr\"unbaum--Hadwiger--Ramos measure equipartition problem in the case of two hyperplanes. Our proof proceeds by establishing topological Radon-type intersection theorems and then applying Gale duality in the linear setting. For a single hyperplane, this gives a new proof of Dolnikov's original result via Sarkaria's non-embedding criterion for simplicial complexes.


title: What Language Model to Train if You Have One Million GPU Hours?

abstract: The crystallization of modeling methods around the Transformer architecture has been a boon for practitioners. Simple, well-motivated architectural variations can transfer across tasks and scale, increasing the impact of modeling research. However, with the emergence of state-of-the-art 100B+ parameters models, large language models are increasingly expensive to accurately design and train. Notably, it can be difficult to evaluate how modeling decisions may impact emergent capabilities, given that these capabilities arise mainly from sheer scale alone. In the process of building BLOOM--the Big Science Large Open-science Open-access Multilingual language model--our goal is to identify an architecture and training setup that makes the best use of our 1,000,000 A100-GPU-hours budget. Specifically, we perform an ablation study at the billion-parameter scale comparing different modeling practices and their impact on zero-shot generalization. In addition, we study the impact of various popular pre-training corpora on zero-shot generalization. We also study the performance of a multilingual model and how it compares to the English-only one. Finally, we consider the scaling behaviour of Transformers to choose the target model size, shape, and training setup. All our models and code are open-sourced at https://huggingface.co/bigscience .


title: HEiMDaL: Highly Efficient Method for Detection and Localization of wake-words

abstract: Streaming keyword spotting is a widely used solution for activating voice assistants. Deep Neural Networks with Hidden Markov Model (DNN-HMM) based methods have proven to be efficient and widely adopted in this space, primarily because of the ability to detect and identify the start and end of the wake-up word at low compute cost. However, such hybrid systems suffer from loss metric mismatch when the DNN and HMM are trained independently. Sequence discriminative training cannot fully mitigate the loss-metric mismatch due to the inherent Markovian style of the operation. We propose an low footprint CNN model, called HEiMDaL, to detect and localize keywords in streaming conditions. We introduce an alignment-based classification loss to detect the occurrence of the keyword along with an offset loss to predict the start of the keyword. HEiMDaL shows 73% reduction in detection metrics along with equivalent localization accuracy and with the same memory footprint as existing DNN-HMM style models for a given wake-word.


title: Coulombic Surface-Ion Interactions Induce Nonlinear and Chemistry-Specific Charging Kinetics

abstract: While important for many industrial applications, chemical reactions responsible for charging of solids in water are often poorly understood. We theoretically investigate the charging kinetics of solid-liquid interfaces, and find that the time-dependent equilibration of surface charge contains key information not only on the reaction mechanism, but also on the valency of the reacting ions. We construct a non-linear differential equation describing surface charging by combining chemical Langmuir kinetics and electrostatic Poisson-Boltzmann theory. Our results reveal a clear distinction between late-time (near-equilibrium) and short-time (far-from-equilibrium) relaxation rates, the ratio of which contains information on the charge valency and ad- or desorption mechanism of the charging process. Similarly, we find that single-ion reactions can be distinguished from two-ion reactions as the latter show an inflection point during equilibration. Interestingly, such inflection points are characteristic of autocatalytic reactions, and we conclude that the Coulombic ion-surface interaction is an autocatalytic feedback mechanism.


title: Are You Stealing My Model? Sample Correlation for Fingerprinting Deep Neural Networks

abstract: An off-the-shelf model as a commercial service could be stolen by model stealing attacks, posing great threats to the rights of the model owner. Model fingerprinting aims to verify whether a suspect model is stolen from the victim model, which gains more and more attention nowadays. Previous methods always leverage the transferable adversarial examples as the model fingerprint, which is sensitive to adversarial defense or transfer learning scenarios. To address this issue, we consider the pairwise relationship between samples instead and propose a novel yet simple model stealing detection method based on SAmple Correlation (SAC). Specifically, we present SAC-w that selects wrongly classified normal samples as model inputs and calculates the mean correlation among their model outputs. To reduce the training time, we further develop SAC-m that selects CutMix Augmented samples as model inputs, without the need for training the surrogate models or generating adversarial examples. Extensive results validate that SAC successfully defends against various model stealing attacks, even including adversarial training or transfer learning, and detects the stolen models with the best performance in terms of AUC across different datasets and model architectures. The codes are available at https://github.com/guanjiyang/SAC.


title: Time-Domain Based Embeddings for Spoofed Audio Representation

abstract: Anti-spoofing is the task of speech authentication. That is, identifying genuine human speech compared to spoofed speech. The main focus of this paper is to suggest new representations for genuine and spoofed speech, based on the probability mass function (PMF) estimation of the audio waveforms' amplitude. We introduce a new feature extraction method for speech audio signals: unlike traditional methods, our method is based on direct processing of time-domain audio samples. The PMF is utilized by designing a feature extractor based on different PMF distances and similarity measures. As an additional step, we used filter-bank preprocessing, which significantly affects the discriminative characteristics of the features and facilitates convenient visualization of possible clustering of spoofing attacks. Furthermore, we use diffusion maps to reveal the underlying manifold on which the data lies. The suggested embeddings allow the use of simple linear separators to achieve decent performance. In addition, we present a convenient way to visualize the data, which helps to assess the efficiency of different spoofing techniques. The experimental results show the potential of using multi-channel PMF based features for the anti-spoofing task, in addition to the benefits of using diffusion maps both as an analysis tool and as an embedding tool.


title: Multi-view Representation Learning from Malware to Defend Against Adversarial Variants

abstract: Deep learning-based adversarial malware detectors have yielded promising results in detecting never-before-seen malware executables without relying on expensive dynamic behavior analysis and sandbox. Despite their abilities, these detectors have been shown to be vulnerable to adversarial malware variants - meticulously modified, functionality-preserving versions of original malware executables generated by machine learning. Due to the nature of these adversarial modifications, these adversarial methods often use a \textit{single view} of malware executables (i.e., the binary/hexadecimal view) to generate adversarial malware variants. This provides an opportunity for the defenders (i.e., malware detectors) to detect the adversarial variants by utilizing more than one view of a malware file (e.g., source code view in addition to the binary view). The rationale behind this idea is that while the adversary focuses on the binary view, certain characteristics of the malware file in the source code view remain untouched which leads to the detection of the adversarial malware variants. To capitalize on this opportunity, we propose Adversarially Robust Multiview Malware Defense (ARMD), a novel multi-view learning framework to improve the robustness of DL-based malware detectors against adversarial variants. Our experiments on three renowned open-source deep learning-based malware detectors across six common malware categories show that ARMD is able to improve the adversarial robustness by up to seven times on these malware detectors.


title: Student-centric Model of Learning Management System Activity and Academic Performance: from Correlation to Causation

abstract: In recent years, there is a lot of interest in modeling students' digital traces in Learning Management System (LMS) to understand students' learning behavior patterns including aspects of meta-cognition and self-regulation, with the ultimate goal to turn those insights into actionable information to support students to improve their learning outcomes. In achieving this goal, however, there are two main issues that need to be addressed given the existing literature. Firstly, most of the current work is course-centered (i.e. models are built from data for a specific course) rather than student-centered; secondly, a vast majority of the models are correlational rather than causal. Those issues make it challenging to identify the most promising actionable factors for intervention at the student level where most of the campus-wide academic support is designed for. In this paper, we explored a student-centric analytical framework for LMS activity data that can provide not only correlational but causal insights mined from observational data. We demonstrated this approach using a dataset of 1651 computing major students at a public university in the US during one semester in the Fall of 2019. This dataset includes students' fine-grained LMS interaction logs and administrative data, e.g. demographics and academic performance. In addition, we expand the repository of LMS behavior indicators to include those that can characterize the time-of-the-day of login (e.g. chronotype). Our analysis showed that student login volume, compared with other login behavior indicators, is both strongly correlated and causally linked to student academic performance, especially among students with low academic performance. We envision that those insights will provide convincing evidence for college student support groups to launch student-centered and targeted interventions that are effective and scalable.


title: Killing tensors of generalized Lense-Thirring space-time

abstract: We investigate the Hamilton-Jacobi equation of a probe particle moving on d-dimensional generalized Lense-Thirring metric. This space-time is different from the slowly rotating Myers-Perry black hole at second order in rotation parameters. We show that the dynamics of the probe particle along the time-like geodesic of the generalized Lense-Thirring space-time is super-integrable and has more constants of motion with respect to the same dynamics on Myers-Perry black hole. We also discuss the second rank Killing tensors associated with the generalized Lense-Thirring metric.


title: Many-Objective Reinforcement Learning for Online Testing of DNN-Enabled Systems

abstract: Deep Neural Networks (DNNs) have been widely used to perform real-world tasks in cyber-physical systems such as Autonomous Driving Systems (ADS). Ensuring the correct behavior of such DNN-Enabled Systems (DES) is a crucial topic. Online testing is one of the promising modes for testing such systems with their application environments (simulated or real) in a closed loop taking into account the continuous interaction between the systems and their environments. However, the environmental variables (e.g., lighting conditions) that might change during the systems' operation in the real world, causing the DES to violate requirements (safety, functional), are often kept constant during the execution of an online test scenario due to the two major challenges: (1) the space of all possible scenarios to explore would become even larger if they changed and (2) there are typically many requirements to test simultaneously. In this paper, we present MORLOT (Many-Objective Reinforcement Learning for Online Testing), a novel online testing approach to address these challenges by combining Reinforcement Learning (RL) and many-objective search. MORLOT leverages RL to incrementally generate sequences of environmental changes while relying on many-objective search to determine the changes so that they are more likely to achieve any of the uncovered objectives. We empirically evaluate MORLOT using CARLA, a high-fidelity simulator widely used for autonomous driving research, integrated with Transfuser, a DNN-enabled ADS for end-to-end driving. The evaluation results show that MORLOT is significantly more effective and efficient than alternatives with a large effect size. In other words, MORLOT is a good option to test DES with dynamically changing environments while accounting for multiple safety requirements.


title: An f(R,T) Gravity Based FLRW Model and Observational Constraints

abstract: We attempt to construct a Friedmann-Lemaitre-Robertson-Walker(FLRW) cosmological model in $f(R, T)$ gravity which exhibits a phase transition from deceleration to acceleration at present. We take $f(R,T) = R + 2 \lambda T$, $\lambda$ being an arbitrary constant. In our model, the $\lambda$ parameter develops a negative pressure in the universe whose Equation of state is parameterized. The present values of model parameters such as density, Hubble, deceleration, Equation of state, and $\lambda$ are estimated statistically by using the Chi-Square test. For this, we have used three different types of observational data sets: the $46$ Hubble parameter data set, the SNeIa $715$ data sets of distance modulus, and the 66 Pantheon data set (the latest compilation of SNeIa 40 bined plus 26 high red shift apparent magnitude $m_b$ data set in the red shift ranges from $0.014 \leq z \leq 2.26 $). We have calculated the transitional red shift and time. The estimated results for the present values of various model parameters are found as per expectations and surveys. Interestingly, we get the present value of the density $\rho_0$, $\simeq 1.5 \rho_c $. The critical density is estimated as $\rho_c\simeq 1.88 ~ h_0^2~10^{-29}~gm/cm^3 $ in the literature. The higher value of the present density is attributed to the presence of some additional energies in the universe apart from baryon energy. We have examined the behavior of the pressure in our model. It is negative and produces acceleration in the universe. Its present value is obtained as $p_0 \simeq - 0.7 \rho_0$.


title: Multi-layered Discriminative Restricted Boltzmann Machine with Untrained Probabilistic Layer

abstract: An extreme learning machine (ELM) is a three-layered feed-forward neural network having untrained parameters, which are randomly determined before training. Inspired by the idea of ELM, a probabilistic untrained layer called a probabilistic-ELM (PELM) layer is proposed, and it is combined with a discriminative restricted Boltzmann machine (DRBM), which is a probabilistic three-layered neural network for solving classification problems. The proposed model is obtained by stacking DRBM on the PELM layer. The resultant model (i.e., multi-layered DRBM (MDRBM)) forms a probabilistic four-layered neural network. In MDRBM, the parameters in the PELM layer can be determined using Gaussian-Bernoulli restricted Boltzmann machine. Owing to the PELM layer, MDRBM obtains a strong immunity against noise in inputs, which is one of the most important advantages of MDRBM. Numerical experiments using some benchmark datasets, MNIST, Fashion-MNIST, Urban Land Cover, and CIFAR-10, demonstrate that MDRBM is superior to other existing models, particularly, in terms of the noise-robustness property (or, in other words, the generalization property).


title: Grokking phase transitions in learning local rules with gradient descent

abstract: We discuss two solvable grokking (generalisation beyond overfitting) models in a rule learning scenario. We show that grokking is a phase transition and find exact analytic expressions for the critical exponents, grokking probability, and grokking time distribution. Further, we introduce a tensor-network map that connects the proposed grokking setup with the standard (perceptron) statistical learning theory and show that grokking is a consequence of the locality of the teacher model. As an example, we analyse the cellular automata learning task, numerically determine the critical exponent and the grokking time distributions and compare them with the prediction of the proposed grokking model. Finally, we numerically analyse the connection between structure formation and grokking.


title: The weight distribution of codes over finite chain rings

abstract: In this work, we determine new linear equations for the weight distribution of linear codes over finite chain rings. The identities are determined by counting the number of some special submatrices of the parity-check matrix of the code. Thanks to these relations we are able to compute the full weight distribution of codes with small Singleton defects, such as MDS, MDR and AMDR codes.


title: TRIM Simulations Tool for $\mu^+$ Stopping Fraction in Hydrostatic Pressure Cells

abstract: For quantum systems or materials, a common procedure for probing their behaviour is to tune electronic/magnetic properties using external parameters, e.g. temperature, magnetic field or pressure. Pressure application as an external stimuli is a widely used tool, where the sample in question is inserted into a pressure cell providing a hydrostatic pressure condition. Such device causes some practical problems when using in Muon Spin Rotation/Relaxation ($\mu^+$SR) experiments as a large proportion of the muons will be implanted in the pressure cell rather than in the sample, resulting in a higher background signal. This issue gets further amplified when the temperature dependent response from the sample is much smaller than that of the pressure cell,which may cause the sample response to be lost in the background and cause difficulties in aligning the sample within the beam. To tackle this issue, we have used pySRIM to construct a practical and helpful simulation tool for calculating muon stopping fractions, specifically for the pressure cell setup at the $\mu$E1 beamline using the GPD spectrometer at the Paul Scherrer Institute, with the use of TRIM simulations. The program is used to estimate the number of muon stopping in both the sample and the pressure cell at a given momentum. The simulation tool is programmed into a GUI, making it accessible to user to approximate prior to their experiments at GPD what fractions will belong to the sample and the pressure cell in their fitting procedure.