title: Self-Supervised Texture Image Anomaly Detection By Fusing Normalizing Flow and Dictionary Learning

abstract: A common study area in anomaly identification is industrial images anomaly detection based on texture background. The interference of texture images and the minuteness of texture anomalies are the main reasons why many existing models fail to detect anomalies. We propose a strategy for anomaly detection that combines dictionary learning and normalizing flow based on the aforementioned questions. The two-stage anomaly detection approach already in use is enhanced by our method. In order to improve baseline method, this research add normalizing flow in representation learning and combines deep learning and dictionary learning. Improved algorithms have exceeded 95$\%$ detection accuracy on all MVTec AD texture type data after experimental validation. It shows strong robustness. The baseline method's detection accuracy for the Carpet data was 67.9%. The article was upgraded, raising the detection accuracy to 99.7%.


title: Time- vs. frequency- domain inverse elastic scattering: Theory and experiment

abstract: This study formally adapts the time-domain linear sampling method (TLSM) for ultrasonic imaging of stationary and evolving fractures in safety-critical components. The TLSM indicator is then applied to the laboratory test data of [22, 18] and the obtained reconstructions are compared to their frequency-domain counterparts. The results highlight the unique capability of the time-domain imaging functional for high-fidelity tracking of evolving damage, and its relative robustness to sparse and reduced aperture data at moderate noise levels. A comparative analysis of the TLSM images against the multifrequency LSM maps of [22] further reveals that thanks to the full-waveform inversion in time and space, the TLSM generates images of remarkably higher quality with the same dataset.


title: Gromov-Wasserstein Autoencoders

abstract: Variational Autoencoder (VAE)-based generative models offer flexible representation learning by incorporating meta-priors, general premises considered beneficial for downstream tasks. However, the incorporated meta-priors often involve ad-hoc model deviations from the original likelihood architecture, causing undesirable changes in their training. In this paper, we propose a novel representation learning method, Gromov-Wasserstein Autoencoders (GWAE), which directly matches the latent and data distributions using the variational autoencoding scheme. Instead of likelihood-based objectives, GWAE models minimize the Gromov-Wasserstein (GW) metric between the trainable prior and given data distributions. The GW metric measures the distance structure-oriented discrepancy between distributions even with different dimensionalities, which provides a direct measure between the latent and data spaces. By restricting the prior family, we can introduce meta-priors into the latent space without changing their objective. The empirical comparisons with VAE-based models show that GWAE models work in two prominent meta-priors, disentanglement and clustering, with their GW objective unchanged.


title: Logarithmic profiles of velocity in stably stratified atmospheric boundary layers

abstract: The universal velocity log law first proposed by von K\'arm\'an in the near-wall region of turbulent shear flows is one of the cornerstones of turbulence theory. When buoyancy effects are important, the universal velocity log law is typically believed to break down according to Monin-Obukhov similarity theory (MOST), which has been used in almost all global weather and climate models to describe the dependence of the mean velocity profiles on buoyancy in the atmospheric boundary layer. In contrast to MOST, we propose new logarithmic profiles of near-wall mean velocity in the stably stratified atmospheric boundary layers based on direct numerical simulations and field observations across a wide range of buoyancy effects. We find that buoyancy does not change the logarithmic nature of velocity profiles but instead modifies the slope of the log law in stably stratified conditions.


title: Periastron precession effect of $f$-mode dynamical tides on gravitational waves from eccentric double white dwarfs

abstract: The dynamical tide can play an important role in the orbital motion of close eccentric double white dwarf binaries. As the launching of the space-based gravitational-wave detector, the Laser Interferometer Space Antenna (LISA), is just around the corner, detection of gravitational wave signals from such systems is anticipated. In this paper, we discuss the influence of the dynamical tide on eccentric orbits, focusing on the effect on orbital precession. We show that in orbits with a high eccentricity, resonance can cause a large precession when a harmonic of the orbital frequency matches the natural frequencies of the normal modes of the star. In contrast to the case with circular orbits, each mode can encounter multiple resonances with different harmonics and these resonant regions can cover about 10% of the frequency space for orbits with close separations. In this case, the tidal precession effect is distinct from the other contributions and can be identified with LISA if the signal-to-noise ratio is high enough. However, within the highly eccentric-small separation region, the dynamical tide causes chaotic motion and the gravitational wave signal becomes unpredictable. Even not at resonance, the dynamical tide can contribute up to 20% of the precession for orbits close to Roche-lobe filling separation with low eccentricities and LISA can resolve these off-resonant dynamical tide effects within the low eccentricity-small orbital separation region of the parameter space. For lower mass systems, the dynamical tide effect can degenerate with the uncertainties of the eccentricity, making it unmeasurable from the precession rate alone. For higher mass systems, the radiation reaction effect becomes significant enough to constrain the eccentricity, allowing the measurement of the dynamical tide.


title: Computing Galois groups of Fano problems

abstract: A Fano problem consists of enumerating linear spaces of a fixed dimension on a variety, generalizing the classical problem of 27 lines on a cubic surface. Those Fano problems with finitely many linear spaces have an associated Galois group that acts on these linear spaces and controls the complexity of computing them in coordinates via radicals. Galois groups of Fano problems were first studied by Jordan, who considered the Galois group of the problem of 27 lines on a cubic surface. Recently, Hashimoto and Kadets nearly classified all Galois groups of Fano problems by determining them in a special case and by showing that all other Fano problems have Galois group containing the alternating group. We use computational tools to prove that several Fano problems of moderate size have Galois group equal to the symmetric group, each of which were previously unknown.


title: Error Controlled Feature Selection for Ultrahigh Dimensional and Highly Correlated Feature Space Using Deep Learning

abstract: In recent years, deep learning has been at the center of analytics due to its impressive empirical success in analyzing complex data objects. Despite this success, most of the existing tools behave like black-box machines, thus the increasing interest in interpretable, reliable, and robust deep learning models applicable to a broad class of applications. Feature-selected deep learning has emerged as a promising tool in this realm. However, the recent developments do not accommodate ultra-high dimensional and highly correlated features, in addition to the high noise level. In this article, we propose a novel screening and cleaning method with the aid of deep learning for a data-adaptive multi-resolutional discovery of highly correlated predictors with a controlled error rate. Extensive empirical evaluations over a wide range of simulated scenarios and several real datasets demonstrate the effectiveness of the proposed method in achieving high power while keeping the false discovery rate at a minimum.


title: Anderson localization for the quasi-periodic CMV matrices with Verblunsky coefficients defined by the skew-shift

abstract: In this paper, we study quasi-periodic CMV matrices with Verblunsky coefficients given by the skew-shift. We prove the positivity of Lyapunov exponents and Anderson localization for most frequencies, which establish the analogous results of one-dimensional Schr\"{o}dinger operators proved by Bourgain, Goldstein and Schlag.


title: Refined list version of Hadwiger's conjecture

abstract: Assume $\lambda=\{k_1,k_2, \ldots, k_q\}$ is a partition of $k_{\lambda} = \sum_{i=1}^q k_i$. A $\lambda$-list assignment of $G$ is a $k_\lambda$-list assignment $L$ of $G$ such that the colour set $\bigcup_{v \in V(G)}L(v)$ can be partitioned into $|\lambda|= q$ sets $C_1,C_2,\ldots,C_q$ such that for each $i$ and each vertex $v$ of $G$, $|L(v) \cap C_i| \ge k_i$. We say $G$ is \emph{$\lambda$-choosable} if $G$ is $L$-colourable for any $\lambda$-list assignment $L$ of $G$. The concept of $\lambda$-choosability is a refinement of choosability that puts $k$-choosability and $k$-colourability in the same framework. If $|\lambda|$ is close to $k_\lambda$, then $\lambda$-choosability is close to $k_\lambda$-colourability; if $|\lambda|$ is close to $1$, then $\lambda$-choosability is close to $k_\lambda$-choosability. This paper studies Hadwiger's Conjecture in the context of $\lambda$-choosability. Hadwiger's Conjecture is equivalent to saying that every $K_t$-minor-free graph is $\{1 \star (t-1)\}$-choosable for any positive integer $t$. We prove that for $t \ge 5$, for any partition $\lambda$ of $t-1$ other than $\{1 \star (t-1)\}$, there is a $K_t$-minor-free graph $G$ that is not $\lambda$-choosable. We then construct several types of $K_t$-minor-free graphs that are not $\lambda$-choosable, where $k_\lambda - (t-1)$ gets larger as $k_\lambda-|\lambda|$ gets larger. In partcular, for any $q$ and any $\epsilon > 0$, there exists $t_0$ such that for any $t \ge t_0$, for any partition $\lambda$ of $\lfloor (2-\epsilon)t \rfloor$ with $|\lambda| =q$, there is a $K_t$-minor-free graph that is not $\lambda$-choosable. The $q=1$ case of this result was recently proved by Steiner, and our proof uses a similar argument. We also generalize this result to $(a,b)$-list colouring.


title: An Approach to Mismatched Disturbance Rejection Control for Uncontrollable Systems

abstract: This study focuses on the problem of optimal mismatched disturbance rejection control for uncontrollable linear discrete-time systems. In contrast to previous studies, by introducing a quadratic performance index such that the regulated state can track a reference trajectory and minimize the effects of disturbances, mismatched disturbance rejection control is transformed into a linear quadratic tracking problem. The necessary and sufficient conditions for the solvability of this problem over a finite horizon and a disturbance rejection controller are derived by solving a forward-backward difference equation. In the case of an infinite horizon, a sufficient condition for the stabilization of the system is obtained under the detectable condition. This paper details our novel approach to disturbance rejection. Four examples are provided to demonstrate the effectiveness of the proposed method.


title: Upper bounds on the Natarajan dimensions of some function classes

abstract: The Natarajan dimension is a fundamental tool for characterizing multi-class PAC learnability, generalizing the Vapnik-Chervonenkis (VC) dimension from binary to multi-class classification problems. This work establishes upper bounds on Natarajan dimensions for certain function classes, including (i) multi-class decision tree and random forests, and (ii) multi-class neural networks with binary, linear and ReLU activations. These results may be relevant for describing the performance of certain multi-class learning algorithms.


title: Algorithms and Lower Bounds for Replacement Paths under Multiple Edge Failures

abstract: This paper considers a natural fault-tolerant shortest paths problem: for some constant integer $f$, given a directed weighted graph with no negative cycles and two fixed vertices $s$ and $t$, compute (either explicitly or implicitly) for every tuple of $f$ edges, the distance from $s$ to $t$ if these edges fail. We call this problem $f$-Fault Replacement Paths ($f$FRP). We first present an $\tilde{O}(n^3)$ time algorithm for $2$FRP in $n$-vertex directed graphs with arbitrary edge weights and no negative cycles. As $2$FRP is a generalization of the well-studied Replacement Paths problem (RP) that asks for the distances between $s$ and $t$ for any single edge failure, $2$FRP is at least as hard as RP. Since RP in graphs with arbitrary weights is equivalent in a fine-grained sense to All-Pairs Shortest Paths (APSP) [Vassilevska Williams and Williams FOCS'10, J.~ACM'18], $2$FRP is at least as hard as APSP, and thus a substantially subcubic time algorithm in the number of vertices for $2$FRP would be a breakthrough. Therefore, our algorithm in $\tilde{O}(n^3)$ time is conditionally nearly optimal. Our algorithm implies an $\tilde{O}(n^{f+1})$ time algorithm for the $f$FRP problem, giving the first improvement over the straightforward $O(n^{f+2})$ time algorithm. Then we focus on the restriction of $2$FRP to graphs with small integer weights bounded by $M$ in absolute values. Using fast rectangular matrix multiplication, we obtain a randomized algorithm that runs in $\tilde{O}(M^{2/3}n^{2.9153})$ time. This implies an improvement over our $\tilde{O}(n^{f+1})$ time arbitrary weight algorithm for all $f>1$. We also present a data structure variant of the algorithm that can trade off pre-processing and query time. In addition to the algebraic algorithms, we also give an $n^{8/3-o(1)}$ conditional lower bound for combinatorial $2$FRP algorithms in directed unweighted graphs.


title: $^{75}$As NMR study of the antiferromagnetic Kondo lattice compound CeNiAsO

abstract: We revisit the magnetic properties of the antiferromagnetic Kondo lattice CeNiAsO by $^{75}$As nuclear magnetic resonance measurements. Our results confirm two successive antiferromagnetic transitions of Ce moments at $T_{N1}=9.0(3)$ K and $T_{N2}=7.0(3)$ K. Incommensurate and commensurate antiferromagnetic orders are suggested for $T_{N2}<T<T_{N1}$ and $T<T_{N2}$ respectively, consistent with previous neutron and muon experiments. A Knight shift anomaly, characterized by the failure of $K(T)-\chi(T)$ scaling, is observed below $T^*\sim15$ K, which gives a measure of the onset of coherent $c-f$ correlations. This energy scale is further confirmed by the spin-lattice relaxation rate ($1/T_1$). The analysis of spin dynamics also reveals a quasi-two-dimensional character of spin fluctuations in CeNiAsO. This work paves the way for further $^{75}$As nuclear magnetic resonance studies under pressure.


title: FRANS: Automatic Feature Extraction for Time Series Forecasting

abstract: Feature extraction methods help in dimensionality reduction and capture relevant information. In time series forecasting (TSF), features can be used as auxiliary information to achieve better accuracy. Traditionally, features used in TSF are handcrafted, which requires domain knowledge and significant data-engineering work. In this research, we first introduce a notion of static and dynamic features, which then enables us to develop our autonomous Feature Retrieving Autoregressive Network for Static features (FRANS) that does not require domain knowledge. The method is based on a CNN classifier that is trained to create for each series a collective and unique class representation either from parts of the series or, if class labels are available, from a set of series of the same class. It allows to discriminate series with similar behaviour but from different classes and makes the features extracted from the classifier to be maximally discriminatory. We explore the interpretability of our features, and evaluate the prediction capabilities of the method within the forecasting meta-learning environment FFORMA. Our results show that our features lead to improvement in accuracy in most situations. Once trained our approach creates features orders of magnitude faster than statistical methods.


title: Probing Large Scale Ionizing Background Fluctuation with Lyman $\alpha$ Forest and Galaxy Cross-correlation at z=2.4

abstract: The amplitude of the metagalactic ultraviolet background (UVB) at large-scales is impacted by two factors. First, it naturally attenuates at scales larger than mean-free-path of UVB photons due to the absorption by neutral intergalactic medium. Second, there are discrete and rare ionizing sources distributing in the Universe, emitting the UVB photons, and thus enhancing the local UVB amplitude. Therefore, for cosmological probe that is sensitive to the UVB amplitude and capable of detecting the large scale like Lyman-$\alpha$ forest spectrum, the fluctuation due to the clustering of ionizing sources becomes a significant factor for Lyman-$\alpha$ flux transmission and leave imprints on Lyman-$\alpha$ flux power spectrum at these large scales. In this work, we make use of a radiative transfer model that parametrizes the UVB source distribution by its bias $b_{\rm j}$ and shot noise $\overline{n}_{\rm j}$. We estimate the constraints on this model through the cross-correlation between Lyman-$\alpha$ forest survey and galaxy survey, using the DESI Lyman-$\alpha$ forest survey and the Roman Space Telescope emission line galaxy survey as an example. We show the detection sensitivity improvement for UVB parameters from disjoint to maximal overlap of DESI+Roman survey strategy. We also show that the degeneracy of two ionizing source parameters can be broken by increasing the overlapping survey area. Our results motivate survey strategies more dedicated to probe the UVB large-scale fluctuations.


title: Quantification of Market Power Mitigation via Efficient Aggregation of Distributed Energy Resources

abstract: Distributed energy resources (DERs) such as solar panels have small supply capacities and cannot be directly integrated into wholesale markets. So, the presence of an intermediary is critical. The intermediary could be a profit-seeking entity (called the aggregator) that buys DER supply from prosumers, and then sells them in the wholesale electricity market. Thus, DER integration has an influence on wholesale market prices, demand, and supply. The purpose of this article is to shed light onto the impact of efficient DER aggregation on the market power of conventional generators. Firstly, under efficient DER aggregation, we quantify the social welfare gap between two cases: when conventional generators are truthful, and when they are strategic. We also do the same when DERs are not present. Secondly, we show that the gap due to market power of generators in the presence of DERs is smaller than the one when there is no DER participation. Finally, we provide explicit expressions of the gaps and conduct numerical experiments to gain deeper insights. The main message of this article is that market power of conventional generators can be mitigated by adopting an efficient DER aggregation model.


title: Quantum State Transfer: Interplay between Gate and Readout Errors

abstract: Quantum networks consist of quantum nodes that are linked by entanglement and quantum information can be transferred from one node to another. Operations can be applied to qubits of local nodes coordinated by classical communication to manipulate quantum states and readout/measurement will be employed to obtain results. Here, we use quantum circuits to simulate quantum state transfer between two nodes connected in a linear geometry through other nodes. We explore the interplay between gate and readout errors on the performance of state transfer. We find that the nominal success probability is not necessarily a monotonic function of the two error rates and employ numerical simulations and analytic tools to understand their interplay.


title: Speeding axion haloscope experiments using heterodyne-variance-based detection with a power-meter

abstract: We describe a new axion search method based on measuring the variance in the interference of the axion signal using injected photons with a power detector. The need for a linear amplifier is eliminated by putting a strong signal into the microwave cavity, to acquire not only the power excess but also measure the variance of the output power. The interference of the external photons with the axion to photon converted signal greatly enhances the variance at the particular axion frequency, providing evidence of its existence. This method has an advantage in that it can always obtain sensitivity near the quantum noise limit even for a power detector with high dark count rate. We describe the basic concept of this method both analytically and numerically, and we show experimental results using a simple demonstration circuit.


title: MR4MR: Mixed Reality for Melody Reincarnation

abstract: There is a long history of an effort made to explore musical elements with the entities and spaces around us, such as musique concr\`ete and ambient music. In the context of computer music and digital art, interactive experiences that concentrate on the surrounding objects and physical spaces have also been designed. In recent years, with the development and popularization of devices, an increasing number of works have been designed in Extended Reality to create such musical experiences. In this paper, we describe MR4MR, a sound installation work that allows users to experience melodies produced from interactions with their surrounding space in the context of Mixed Reality (MR). Using HoloLens, an MR head-mounted display, users can bump virtual objects that emit sound against real objects in their surroundings. Then, by continuously creating a melody following the sound made by the object and re-generating randomly and gradually changing melody using music generation machine learning models, users can feel their ambient melody "reincarnating".


title: Almost Ramanujan Expanders from Arbitrary Expanders via Operator Amplification

abstract: We give an efficient algorithm that transforms any bounded degree expander graph into another that achieves almost optimal (namely, near-quadratic, $d \leq 1/\lambda^{2+o(1)}$) trade-off between (any desired) spectral expansion $\lambda$ and degree $d$. Furthermore, the algorithm is local: every vertex can compute its new neighbors as a subset of its original neighborhood of radius $O(\log(1/\lambda))$. The optimal quadratic trade-off is known as the Ramanujan bound, so our construction gives almost Ramanujan expanders from arbitrary expanders. The locality of the transformation preserves structural properties of the original graph, and thus has many consequences. Applied to Cayley graphs, our transformation shows that any expanding finite group has almost Ramanujan expanding generators. Similarly, one can obtain almost optimal explicit constructions of quantum expanders, dimension expanders, monotone expanders, etc., from existing (suboptimal) constructions of such objects. Another consequence is a "derandomized" random walk on the original (suboptimal) expander with almost optimal convergence rate. Our transformation also applies when the degree is not bounded or the expansion is not constant. We obtain our results by a generalization of Ta-Shma's technique in his breakthrough paper [STOC 2017], used to obtain explicit almost optimal binary codes. Specifically, our spectral amplification extends Ta-Shma's analysis of bias amplification from scalars to matrices of arbitrary dimension in a very natural way. Curiously, while Ta-Shma's explicit bias amplification derandomizes a well-known probabilistic argument (underlying the Gilbert--Varshamov bound), there seems to be no known probabilistic (or other existential) way of achieving our explicit ("high-dimensional") spectral amplification.


title: Dynamic X-Ray Vision in Mixed Reality

abstract: X-ray vision, a technique that allows users to see through walls and other obstacles, is a popular technique for Augmented Reality (AR) and Mixed Reality (MR). In this paper, we demonstrate a dynamic X-ray vision window that is rendered in real-time based on the user's current position and changes with movement in the physical environment. Moreover, the location and transparency of the window are also dynamically rendered based on the user's eye gaze. We build this X-ray vision window for a current state-of-the-art MR Head-Mounted Device (HMD) -- HoloLens 2 by integrating several different features: scene understanding, eye tracking, and clipping primitive.


title: Can We Solve 3D Vision Tasks Starting from A 2D Vision Transformer?

abstract: Vision Transformers (ViTs) have proven to be effective, in solving 2D image understanding tasks by training over large-scale image datasets; and meanwhile as a somehow separate track, in modeling the 3D visual world too such as voxels or point clouds. However, with the growing hope that transformers can become the "universal" modeling tool for heterogeneous data, ViTs for 2D and 3D tasks have so far adopted vastly different architecture designs that are hardly transferable. That invites an (over-)ambitious question: can we close the gap between the 2D and 3D ViT architectures? As a piloting study, this paper demonstrates the appealing promise to understand the 3D visual world, using a standard 2D ViT architecture, with only minimal customization at the input and output levels without redesigning the pipeline. To build a 3D ViT from its 2D sibling, we "inflate" the patch embedding and token sequence, accompanied with new positional encoding mechanisms designed to match the 3D data geometry. The resultant "minimalist" 3D ViT, named Simple3D-Former, performs surprisingly robustly on popular 3D tasks such as object classification, point cloud segmentation and indoor scene detection, compared to highly customized 3D-specific designs. It can hence act as a strong baseline for new 3D ViTs. Moreover, we note that pursing a unified 2D-3D ViT design has practical relevance besides just scientific curiosity. Specifically, we demonstrate that Simple3D-Former naturally enables to exploit the wealth of pre-trained weights from large-scale realistic 2D images (e.g., ImageNet), which can be plugged in to enhancing the 3D task performance "for free".


title: Out-of-Distribution Representation Learning for Time Series Classification

abstract: Time series classification is an important problem in real world. Due to its non-stationary property that the distribution changes over time, it remains challenging to build models for generalization to unseen distributions. In this paper, we propose to view the time series classification problem from the distribution perspective. We argue that the temporal complexity attributes to the unknown latent distributions within. To this end, we propose DIVERSIFY to learn generalized representations for time series classification. DIVERSIFY takes an iterative process: it first obtains the worst-case distribution scenario via adversarial training, then matches the distributions of the obtained sub-domains. We also present some theoretical insights. We conduct experiments on gesture recognition, speech commands recognition, wearable stress and affect detection, and sensor-based human activity recognition with a total of seven datasets in different settings. Results demonstrate that DIVERSIFY significantly outperforms other baselines and effectively characterizes the latent distributions by qualitative and quantitative analysis. Code is available at: https://github.com/microsoft/robustlearn.


title: Estimating large causal polytrees from small samples

abstract: We consider the problem of estimating a large causal polytree from a relatively small i.i.d. sample. This is motivated by the problem of determining causal structure when the number of variables is very large compared to the sample size, such as in gene regulatory networks. We give an algorithm that recovers the tree with high accuracy in such settings. The algorithm works under essentially no distributional or modeling assumptions other than some mild non-degeneracy conditions.

categories: stat.ME cs.LG math.PR math.ST stat.ML stat.TH


title: Quantum manifestation of the classical bifurcation in the driven dissipative Bose-Hubbard dimer

abstract: We analyze the classical and quantum dynamics of the driven dissipative Bose-Hubbard dimer. Under variation of the driving frequency, the classical system is shown to exhibit a bifurcation to the limit cycle, where its steady-state solution corresponds to periodic oscillation with the frequency unrelated to the driving frequency. This bifurcation is shown to lead to a peculiarity in the stationary single-particle density matrix of the quantum system. The case of the Bose-Hubbard trimer, where the discussed limit cycle bifurcates into a chaotic attractor, is briefly discussed.


title: Model-Guided Multi-Contrast Deep Unfolding Network for MRI Super-resolution Reconstruction

abstract: Magnetic resonance imaging (MRI) with high resolution (HR) provides more detailed information for accurate diagnosis and quantitative image analysis. Despite the significant advances, most existing super-resolution (SR) reconstruction network for medical images has two flaws: 1) All of them are designed in a black-box principle, thus lacking sufficient interpretability and further limiting their practical applications. Interpretable neural network models are of significant interest since they enhance the trustworthiness required in clinical practice when dealing with medical images. 2) most existing SR reconstruction approaches only use a single contrast or use a simple multi-contrast fusion mechanism, neglecting the complex relationships between different contrasts that are critical for SR improvement. To deal with these issues, in this paper, a novel Model-Guided interpretable Deep Unfolding Network (MGDUN) for medical image SR reconstruction is proposed. The Model-Guided image SR reconstruction approach solves manually designed objective functions to reconstruct HR MRI. We show how to unfold an iterative MGDUN algorithm into a novel model-guided deep unfolding network by taking the MRI observation matrix and explicit multi-contrast relationship matrix into account during the end-to-end optimization. Extensive experiments on the multi-contrast IXI dataset and BraTs 2019 dataset demonstrate the superiority of our proposed model.


title: A semantic hierarchical graph neural network for text classification

abstract: The key to the text classification task is language representation and important information extraction, and there are many related studies. In recent years, the research on graph neural network (GNN) in text classification has gradually emerged and shown its advantages, but the existing models mainly focus on directly inputting words as graph nodes into the GNN models ignoring the different levels of semantic structure information in the samples. To address the issue, we propose a new hierarchical graph neural network (HieGNN) which extracts corresponding information from word-level, sentence-level and document-level respectively. Experimental results on several benchmark datasets achieve better or similar results compared to several baseline methods, which demonstrate that our model is able to obtain more useful information for classification from samples.


title: Real tensor eigenvalue/vector distributions of the Gaussian tensor model via a four-fermi theory

abstract: Eigenvalue distributions are important dynamical quantities in matrix models, and it is an interesting challenge to study corresponding quantities in tensor models. We study real tensor eigenvalue/vector distributions for real symmetric order-three random tensors with the Gaussian distribution as the simplest case. We first rewrite this problem as the computation of a partition function of a four-fermi theory with $R$ replicated fermions. The partition function is exactly computed for some small-$N,R$ cases, and is shown to precisely agree with Monte Carlo simulations. For large-$N$, it seems difficult to compute it exactly, and we apply an approximation using a self-consistency equation for two-point functions and obtain an analytic expression. It turns out that the real tensor eigenvalue distribution obtained by taking $R=1/2$ is simply the Gaussian within this approximation. We compare the approximate expression with Monte Carlo simulations, and find that, if an extra overall factor depending on $N$ is multiplied to the the expression, it agrees well with the Monte Carlo results. It is left for future study to improve the approximation for large-$N$ to correctly derive the overall factor.


title: A two-phase model of collective memory decay with a dynamical switching point

abstract: Public memories of significant events shared within societies and groups have been conceptualized and studied as collective memory since the 1920s. Thanks to the recent advancement in digitization of public-domain knowledge and online user behaviors, collective memory has now become a subject of rigorous quantitative investigation using large-scale empirical data. Earlier studies, however, typically considered only one dynamical process applied to data obtained in just one specific event category. Here we propose a two-phase mathematical model of collective memory decay that combines exponential and power-law phases, which represent fast (linear) and slow (nonlinear) decay dynamics, respectively. We applied the proposed model to the Wikipedia page view data for articles on significant events in five categories: earthquakes, deaths of notable persons, aviation accidents, mass murder incidents, and terrorist attacks. Results showed that the proposed two-phase model compared favorably with other existing models of collective memory decay in most of the event categories. The estimated model parameters were found to be similar across all the event categories. The proposed model also allowed for detection of a dynamical switching point when the dominant decay dynamics exhibit a phase shift from exponential to power-law. Such decay phase shifts typically occurred about 10 to 11 days after the peak in all of the five event categories.


title: A Temporal Densely Connected Recurrent Network for Event-based Human Pose Estimation

abstract: Event camera is an emerging bio-inspired vision sensors that report per-pixel brightness changes asynchronously. It holds noticeable advantage of high dynamic range, high speed response, and low power budget that enable it to best capture local motions in uncontrolled environments. This motivates us to unlock the potential of event cameras for human pose estimation, as the human pose estimation with event cameras is rarely explored. Due to the novel paradigm shift from conventional frame-based cameras, however, event signals in a time interval contain very limited information, as event cameras can only capture the moving body parts and ignores those static body parts, resulting in some parts to be incomplete or even disappeared in the time interval. This paper proposes a novel densely connected recurrent architecture to address the problem of incomplete information. By this recurrent architecture, we can explicitly model not only the sequential but also non-sequential geometric consistency across time steps to accumulate information from previous frames to recover the entire human bodies, achieving a stable and accurate human pose estimation from event data. Moreover, to better evaluate our model, we collect a large scale multimodal event-based dataset that comes with human pose annotations, which is by far the most challenging one to the best of our knowledge. The experimental results on two public datasets and our own dataset demonstrate the effectiveness and strength of our approach. Code can be available online for facilitating the future research.


title: Online Combinatorial Auctions for Resource Allocation with Supply Costs and Capacity Limits

abstract: We study a general online combinatorial auction problem in algorithmic mechanism design. A provider allocates multiple types of capacity-limited resources to customers that arrive in a sequential and arbitrary manner. Each customer has a private valuation function on bundles of resources that she can purchase (e.g., a combination of different resources such as CPU and RAM in cloud computing). The provider charges payment from customers who purchase a bundle of resources and incurs an increasing supply cost with respect to the totality of resources allocated. The goal is to maximize the social welfare, namely, the total valuation of customers for their purchased bundles, minus the total supply cost of the provider for all the resources that have been allocated. We adopt the competitive analysis framework and provide posted-price mechanisms with optimal competitive ratios. Our pricing mechanism is optimal in the sense that no other online algorithms can achieve a better competitive ratio. We validate the theoretic results via empirical studies of online resource allocation in cloud computing. Our numerical results demonstrate that the proposed pricing mechanism is competitive and robust against system uncertainties and outperforms existing benchmarks.


title: Langevin Autoencoders for Learning Deep Latent Variable Models

abstract: Markov chain Monte Carlo (MCMC), such as Langevin dynamics, is valid for approximating intractable distributions. However, its usage is limited in the context of deep latent variable models owing to costly datapoint-wise sampling iterations and slow convergence. This paper proposes the amortized Langevin dynamics (ALD), wherein datapoint-wise MCMC iterations are entirely replaced with updates of an encoder that maps observations into latent variables. This amortization enables efficient posterior sampling without datapoint-wise iterations. Despite its efficiency, we prove that ALD is valid as an MCMC algorithm, whose Markov chain has the target posterior as a stationary distribution under mild assumptions. Based on the ALD, we also present a new deep latent variable model named the Langevin autoencoder (LAE). Interestingly, the LAE can be implemented by slightly modifying the traditional autoencoder. Using multiple synthetic datasets, we first validate that ALD can properly obtain samples from target posteriors. We also evaluate the LAE on the image generation task, and show that our LAE can outperform existing methods based on variational inference, such as the variational autoencoder, and other MCMC-based methods in terms of the test likelihood.


title: On error-based step size control for discontinuous Galerkin methods for compressible fluid dynamics

abstract: We study temporal step size control of explicit Runge-Kutta methods for compressible computational fluid dynamics (CFD), including the Navier-Stokes equations and hyperbolic systems of conservation laws such as the Euler equations. We demonstrate that error-based approaches are convenient in a wide range of applications and compare them to more classical step size control based on a Courant-Friedrichs-Lewy (CFL) number. Our numerical examples show that error-based step size control is easy to use, robust, and efficient, e.g., for (initial) transient periods, complex geometries, nonlinear shock capturing approaches, and schemes that use nonlinear entropy projections. We demonstrate these properties for problems ranging from well-understood academic test cases to industrially relevant large-scale computations with two disjoint code bases, the open source Julia packages Trixi.jl with OrdinaryDiffEq.jl and the C/Fortran code SSDC based on PETSc.


title: An Optimised Satellite Constellation for Forest Fire Detection through Edge Computing

abstract: The end of 2019 marked a bushfire crisis for Australia that affected more than 100000km2 of land and destroyed more than 2000 houses. Here, we propose a method of in-orbit bushfire detection with high efficiency to prevent a repetition of this disaster. An LEO satellite constellation is first developed through NSGA-II (Nondominated Sorting Genetic Algorithm II), optimising for coverage over Australia. Then edge computing is adopted to run a bushfire detection algorithm using several constellation satellites as edge nodes to reduce fire detection time. A geostationary satellite is used for inter-satellite communications, such that an image taken by a satellite can be distributed among several satellites for processing. The geostationary satellite also maintains a constant link to the ground, so that a bushfire detection can be reported back without any significant delay. Overall, this system is able to detect fires that span more than 5m in length, and can make detections in 1.39s per image processed. This is faster than any currently available bushfire detection method.


title: Sparsity Inducing Representations for Policy Decompositions

abstract: Policy Decomposition (PoDec) is a framework that lessens the curse of dimensionality when deriving policies to optimal control problems. For a given system representation, i.e. the state variables and control inputs describing a system, PoDec generates strategies to decompose the joint optimization of policies for all control inputs. Thereby, policies for different inputs are derived in a decoupled or cascaded fashion and as functions of some subsets of the state variables, leading to reduction in computation. However, the choice of system representation is crucial as it dictates the suboptimality of the resulting policies. We present a heuristic method to find a representation more amenable to decomposition. Our approach is based on the observation that every decomposition enforces a sparsity pattern in the resulting policies at the cost of optimality and a representation that already leads to a sparse optimal policy is likely to produce decompositions with lower suboptimalities. As the optimal policy is not known we construct a system representation that sparsifies its LQR approximation. For a simplified biped, a 4 degree-of-freedom manipulator, and a quadcopter, we discover decompositions that offer 10% reduction in trajectory costs over those identified by vanilla PoDec. Moreover, the decomposition policies produce trajectories with substantially lower costs compared to policies obtained from state-of-the-art reinforcement learning algorithms.


title: Learning-Based Adaptive Control for Stochastic Linear Systems with Input Constraints

abstract: We propose a certainty-equivalence scheme for adaptive control of scalar linear systems subject to additive, i.i.d. Gaussian disturbances and bounded control input constraints, without requiring prior knowledge of the bounds of the system parameters, nor the control direction. Assuming that the system is at-worst marginally stable, mean square boundedness of the closed-loop system states is proven. Lastly, numerical examples are presented to illustrate our results.


title: Diversity beyond density: experienced social mixing of urban streets

abstract: Urban density, in the form of residents' and visitors' concentration, is long considered to foster diverse exchanges of interpersonal knowledge and skills, which are intrinsic to sustainable human settlements. However, with current urban studies primarily devoted to city and district-level analysis, we cannot unveil the elemental connection between urban density and diversity. Here we use an anonymized and privacy-enhanced mobile data set of 0.5 million opted-in users from three metropolitan areas in the U.S to show that at the scale of urban streets, density is not the only path to diversity. We represent the diversity of each street with the Experienced Social Mixing (ESM), which describes the chances of people meeting diverse income groups throughout their daily experience. We conduct multiple experiments and show that the concentration of visitors only explains 26% of street-level ESM. However, adjacent amenities, residential diversity, and income level account for 44% of the ESM. Moreover, using longitudinal business data, we show that streets with an increased number of food businesses have seen an increased ESM from 2016 to 2018. Lastly, although streets with more visitors are more likely to have crime, diverse streets tend to have fewer crimes. These findings suggest that cities can leverage many tools beyond density to curate a diverse and safe street experience for people.


title: Efficient Perception, Planning, and Control Algorithm for Vision-Based Automated Vehicles

abstract: Autonomous vehicles have limited computational resources and thus require efficient control systems. The cost and size of sensors have limited the development of self-driving cars. To overcome these restrictions, this study proposes an efficient framework for the operation of vision-based automatic vehicles; the framework requires only a monocular camera and a few inexpensive radars. The proposed algorithm comprises a multi-task UNet (MTUNet) network for extracting image features and constrained iterative linear quadratic regulator (CILQR) and vision predictive control (VPC) modules for rapid motion planning and control. MTUNet is designed to simultaneously solve lane line segmentation, the ego vehicle's heading angle regression, road type classification, and traffic object detection tasks at approximately 40 FPS for 228 x 228 pixel RGB input images. The CILQR controllers then use the MTUNet outputs and radar data as inputs to produce driving commands for lateral and longitudinal vehicle guidance within only 1 ms. In particular, the VPC algorithm is included to reduce steering command latency to below actuator latency, preventing performance degradation during tight turns. The VPC algorithm uses road curvature data from MTUNet to estimate the appropriate correction for the current steering angle at a look-ahead point to adjust the turning amount. The inclusion of the VPC algorithm in a VPC-CILQR controller leads to higher performance on curvy roads than the use of CILQR alone. Our experiments demonstrate that the proposed autonomous driving system, which does not require high-definition maps, can be applied in current autonomous vehicles.


title: Towards self-attention based visual navigation in the real world

abstract: Vision guided navigation requires processing complex visual information to inform task-orientated decisions. Applications include autonomous robots, self-driving cars, and assistive vision for humans. A key element is the extraction and selection of relevant features in pixel space upon which to base action choices, for which Machine Learning techniques are well suited. However, Deep Reinforcement Learning agents trained in simulation often exhibit unsatisfactory results when deployed in the real-world due to perceptual differences known as the $\textit{reality gap}$. An approach that is yet to be explored to bridge this gap is self-attention. In this paper we (1) perform a systematic exploration of the hyperparameter space for self-attention based navigation of 3D environments and qualitatively appraise behaviour observed from different hyperparameter sets, including their ability to generalise; (2) present strategies to improve the agents' generalisation abilities and navigation behaviour; and (3) show how models trained in simulation are capable of processing real world images meaningfully in real time. To our knowledge, this is the first demonstration of a self-attention based agent successfully trained in navigating a 3D action space, using less than 4000 parameters.


title: Fair Inference for Discrete Latent Variable Models

abstract: It is now well understood that machine learning models, trained on data without due care, often exhibit unfair and discriminatory behavior against certain populations. Traditional algorithmic fairness research has mainly focused on supervised learning tasks, particularly classification. While fairness in unsupervised learning has received some attention, the literature has primarily addressed fair representation learning of continuous embeddings. In this paper, we conversely focus on unsupervised learning using probabilistic graphical models with discrete latent variables. We develop a fair stochastic variational inference technique for the discrete latent variables, which is accomplished by including a fairness penalty on the variational distribution that aims to respect the principles of intersectionality, a critical lens on fairness from the legal, social science, and humanities literature, and then optimizing the variational parameters under this penalty. We first show the utility of our method in improving equity and fairness for clustering using na\"ive Bayes and Gaussian mixture models on benchmark datasets. To demonstrate the generality of our approach and its potential for real-world impact, we then develop a special-purpose graphical model for criminal justice risk assessments, and use our fairness approach to prevent the inferences from encoding unfair societal biases.


title: Formation of moons and equatorial ridge around top-shaped asteroids after surface landslide

abstract: Top-shaped asteroids have been observed among near-Earth asteroids. About half of them are reported to have moons (on the order of $\sim 1$wt.\% of the top-shaped primary) and many of them have an equatorial ridge. A recent study has shown that the enigmatic top-shaped figure of asteroids (e.g., Ryugu, Bennu, and Didymos) could result from an axisymmetric landslide of the primary during a fast spin-up near the breakup rotation period. Such a landslide would inevitably form a particulate disk around an asteroid with a short timescale ($\sim 3$ hours). However, the long-term full dynamical evolution is not investigated. Here, we perform a continuous simulation ($\sim 700$ hours) that investigates the sequence of events from the surface landslide that forms a top-shaped asteroid and a particulate disk to disk evolution. We show that the disk quickly spreads and produces moons (within $\sim 300$ hours). The mass of the formed moon is consistent with what is observed around the top-shaped asteroids. We also demonstrate that an equatorial ridge is naturally formed because a fraction of the disk particles re-accretes selectively onto the equatorial region of the primary. We envision that Ryugu and Bennu could once have an ancient moon that was later lost due to a successive moon's orbital evolution. Alternatively, at the top-shaped asteroid that has a moon, such as Didymos, no significant orbital evolution of the moon has occurred that would result in its loss. Our study would also be qualitatively applicable to any rubble-pile asteroids near the breakup rotation period.


title: Exploring Visual Interpretability for Contrastive Language-Image Pre-training

abstract: Contrastive Language-Image Pre-training (CLIP) learns rich representations via readily available supervision of natural language. It improves the performance of downstream vision tasks, including but not limited to the zero-shot, long tail, segmentation, retrieval, caption, and video. However, the visual explainability of CLIP is rarely studied, especially for the raw feature map. To provide visual explanations of its predictions, we propose the Image-Text Similarity Map (ITSM). Based on it, we surprisingly find that CLIP prefers the background regions than the foregrounds, and shows erroneous visualization results against human understanding. This phenomenon is universal for both vision transformers and convolutional networks, which suggests this problem is unique and not owing to certain network. Experimentally, we find the devil is in the pooling part, where inappropriate pooling methods lead to a phenomenon called semantic shift. For this problem, we propose the Explainable Contrastive Language-Image Pre-training (ECLIP), which corrects the explainability via the Masked Max Pooling. Specifically, to avoid the semantic shift, we replace the original attention pooling by max pooling to focus on the confident foreground, with guidance from free attention during training. Experiments on three datasets suggest that ECLIP greatly improves the explainability of CLIP, and beyond previous explainability methods at large margins. The code will be released later.


title: iFlipper: Label Flipping for Individual Fairness

abstract: As machine learning becomes prevalent, mitigating any unfairness present in the training data becomes critical. Among the various notions of fairness, this paper focuses on the well-known individual fairness, which states that similar individuals should be treated similarly. While individual fairness can be improved when training a model (in-processing), we contend that fixing the data before model training (pre-processing) is a more fundamental solution. In particular, we show that label flipping is an effective pre-processing technique for improving individual fairness. Our system iFlipper solves the optimization problem of minimally flipping labels given a limit to the individual fairness violations, where a violation occurs when two similar examples in the training data have different labels. We first prove that the problem is NP-hard. We then propose an approximate linear programming algorithm and provide theoretical guarantees on how close its result is to the optimal solution in terms of the number of label flips. We also propose techniques for making the linear programming solution more optimal without exceeding the violations limit. Experiments on real datasets show that iFlipper significantly outperforms other pre-processing baselines in terms of individual fairness and accuracy on unseen test sets. In addition, iFlipper can be combined with in-processing techniques for even better results.


title: Automatically Recommend Code Updates: Are We There Yet?

abstract: In recent years, large pre-trained Language Models of Code (CodeLMs) have shown promising results on various software engineering tasks. One such task is automatic code update recommendation, which transforms outdated code snippets into their approved and revised counterparts. Although many CodeLM-based approaches have been proposed, claiming high accuracy, their effectiveness and reliability on real-world code update tasks remain questionable. In this paper, we present the first extensive evaluation of state-of-the-art CodeLMs for automatically recommending code updates. We assess their performance on two diverse datasets of paired updated methods, considering factors such as temporal evolution, project specificity, method size, and update complexity. Our results reveal that while CodeLMs perform well in settings that ignore temporal information, they struggle in more realistic time-wise scenarios and generalize poorly to new projects. Furthermore, CodeLM performance decreases significantly for larger methods and more complex updates. Furthermore, we observe that many CodeLM-generated "updates" are actually null, especially in time-wise settings, and meaningful edits remain challenging. Our findings highlight the significant gap between the perceived and actual effectiveness of CodeLMs for real-world code update recommendation and emphasize the need for more research on improving their practicality, robustness, and generalizability.


title: Testing the polarization of gravitational wave background with LISA-TianQin network

abstract: While general relativity predicts only two tensor modes for gravitational wave polarization, general metric theories of gravity allows up to four additional modes, including two vector and two scalar modes. Observing the polarization modes of gravitational waves could provide a direct test of the modified gravity. The stochastic gravitational wave background (SGWB), which may be detected by space-based laser-interferometric detectors at design sensitivity, will provide an opportunity to directly measure alternative polarization. In this paper, we investigate the performance of the LISA-TianQin network for detecting alternative polarizations of stochastic backgrounds, and propose a method to separate different polarization modes. First, we generalize the small antenna approximation to compute the overlap reduction functions for SGWB with arbitrary polarization, which is suitable for any time-delay interferometry combination. Then we analyze the detection capability of LISA-TianQin for SGWB with different polarizations. Based on the LISA-TianQin orbital characteristics, we propose a method to distinguish different polarization modes from their mixed data. Compared with ground-based detectors, the LISA-TianQin network is more capable of resolving polarizations of SGWB. In particular, the LISA-TianQin network has the potential to resolve two scalar modes that ground-based detectors cannot.


title: Scalar-tensor gravity from thermodynamic and fluid-gravity perspective

abstract: Out of several possible extensions of general relativity, the scalar-tensor theory is the most popular for several reasons. Since the quantum description of gravity is yet to be formulated properly, the understanding of a gravitational theory remains incomplete until the study of thermodynamic and fluid-gravity aspects, which provides an alternative viewpoint to understand the gravitational theory. In this review, we study these features (thermodynamics and the fluid gravity analogy) in a rigorous and yet in a concise manner for the scalar-tensor gravity, which has been revealed in our recent works. In addition, the issue of conformally connected frames (\textit{i.e.} whether the two frames, which are conformally related are physically equivalent) has been explored in an explicit manner at the action level as well as from the viewpoint of thermodynamics and fluid-gravity correspondence.


title: Spin-orbital-angular-momentum-coupled quantum gases

abstract: We briefly review the recent progress of theories and experiments on spin-orbital-angular-momentum (SOAM)-coupled quantum gases. The coupling between the intrinsic degree of freedom of particles and their external orbital motions widely exists in universe, and leads to a broad variety of fundamental phenomena both in the classical physics and quantum mechanics. Recent realization of synthetic SOAM coupling in cold atoms has attracted a great deal of attention, and stimulates a large amount of considerations on exotic quantum phases in both Bose and Fermi gases. In this review, we present a basic idea of engineering SOAM coupling in neutral atoms, starting from a semiclassical description of atom-light interaction. Unique features of the single-particle physics in the presence of SOAM coupling are discussed. The intriguing ground-state quantum phases of weakly interacting Bose gases are introduced, with emphasis on a so-called angular stripe phase, which has yet been observed at present. It is demonstrated how to generate a stable giant vortex in a SOAM-coupled Fermi superfluid. We also discuss topological characters of a Fermi superfluid in the presence of SOAM coupling. We then introduce the experimental achievement of SOAM coupling in $^{87}$Rb Bose gases and its first observation of phase transitions. The most recent development of SOAM-coupled Bose gases in experiments is also summarized. Regarding the controllability of ultracold quantum gases, it opens a new era, on the quantum simulation point of view, to study the fundamental physics resulted from SOAM coupling as well as newly emergent quantum phases.


title: MIPI 2022 Challenge on Under-Display Camera Image Restoration: Methods and Results

abstract: Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). To bridge the gap, we introduce the first MIPI challenge including five tracks focusing on novel image sensors and imaging algorithms. In this paper, we summarize and review the Under-Display Camera (UDC) Image Restoration track on MIPI 2022. In total, 167 participants were successfully registered, and 19 teams submitted results in the final testing phase. The developed solutions in this challenge achieved state-of-the-art performance on Under-Display Camera Image Restoration. A detailed description of all models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://github.com/mipi-challenge/MIPI2022.


title: Accuracy of the Uzbek stop words detection: a case study on "School corpus"

abstract: Stop words are very important for information retrieval and text analysis investigation tasks of natural language processing. Current work presents a method to evaluate the quality of a list of stop words aimed at automatically creating techniques. Although the method proposed in this paper was tested on an automatically-generated list of stop words for the Uzbek language, it can be, with some modifications, applied to similar languages either from the same family or the ones that have an agglutinative nature. Since the Uzbek language belongs to the family of agglutinative languages, it can be explained that the automatic detection of stop words in the language is a more complex process than in inflected languages. Moreover, we integrated our previous work on stop words detection in the example of the "School corpus" by investigating how to automatically analyse the detection of stop words in Uzbek texts. This work is devoted to answering whether there is a good way of evaluating available stop words for Uzbek texts, or whether it is possible to determine what part of the Uzbek sentence contains the majority of the stop words by studying the numerical characteristics of the probability of unique words. The results show acceptable accuracy of the stop words lists.


title: Lie symmetry approach to the time-dependent Karmarkar condition

abstract: We obtain solutions of the time-dependent Einstein Field Equations which satisfy the Karmarkar condition via the method of Lie symmetries. Spherically symmetric spacetime metrics are used with metric functions set to impose conformal flatness, Weyl-free collapse and shear-free collapse. In particular, a solution was found which satisfies the heat-flux boundary condition of Santos, and a radiating stellar model was then obtained and investigated. Solutions obtained which do not allow for the application of the junction conditions at a boundary surface may lend themselves to cosmological models. This is a first attempt in generating solutions satisfying the Karmarkar condition via the method of Lie symmetries and our example of a radiating model highlights the viability of this method.


title: Valid Utility Games with Information Sharing Constraints

abstract: The use of game theoretic methods for control in multiagent systems has been an important topic in recent research. Valid utility games in particular have been used to model real-world problems; such games have the convenient property that the value of any decision set which is a Nash equilibrium of the game is guaranteed to be within 1/2 of the value of the optimal decision set. However, an implicit assumption in this guarantee is that each agent is aware of the decisions of all other agents. In this work, we first describe how this guarantee degrades as agents are only aware of a subset of the decisions of other agents. We then show that this loss can be mitigated by restriction to a relevant subclass of games.


title: Inequalities for the Broken $k$-Diamond Partition Function

abstract: In 2007, Andrews and Paule introduced the broken $k$-diamond partition function $\Delta_k(n)$, which has received a lot of researches on the arithmetic propertises. In this paper, we prove that $D^3\log \Delta_1(n-1)>0$ for $n\geq 5$ and $D^3 \log \Delta_2(n-1)>0$ for $n\geq 7$, where $D$ is the difference operator with respect to $n$. We also conjecture that for any $k\geq 1$ and $r\geq 1$, there exists a positive integer $n_k(r)$ such that for $n\geq n_{k}(r)$, $(-1)^r D^r \log \Delta_k(n)>0$. This is analogous to the positivity of finite differences of the logarithm of the partition function, which has been proved by Chen, Wang and Xie. Furthermore, we obtain that both $\{\Delta_1(n)\}_{n\geq 0}$ and $\{\Delta_2(n)\}_{n\geq 0}$ satisfy the higher order Tur\'an inequalities for $n \geq 6$.


title: MIPI 2022 Challenge on RGB+ToF Depth Completion: Dataset and Report

abstract: Developing and integrating advanced image sensors with novel algorithms in camera systems is prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). To bridge the gap, we introduce the first MIPI challenge including five tracks focusing on novel image sensors and imaging algorithms. In this paper, RGB+ToF Depth Completion, one of the five tracks, working on the fusion of RGB sensor and ToF sensor (with spot illumination) is introduced. The participants were provided with a new dataset called TetrasRGBD, which contains 18k pairs of high-quality synthetic RGB+Depth training data and 2.3k pairs of testing data from mixed sources. All the data are collected in an indoor scenario. We require that the running time of all methods should be real-time on desktop GPUs. The final results are evaluated using objective metrics and Mean Opinion Score (MOS) subjectively. A detailed description of all models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://github.com/mipi-challenge/MIPI2022.


title: Structure preservation via the Wasserstein distance

abstract: We show that under minimal assumptions on a random vector $X\in\mathbb{R}^d$ and with high probability, given $m$ independent copies of $X$, the coordinate distribution of each vector $(\langle X_i,\theta \rangle)_{i=1}^m$ is dictated by the distribution of the true marginal $\langle X,\theta \rangle$. Specifically, we show that with high probability, \[\sup_{\theta \in S^{d-1}} \left( \frac{1}{m}\sum_{i=1}^m \left|\langle X_i,\theta \rangle^\sharp - \lambda^\theta_i \right|^2 \right)^{1/2} \leq c \left( \frac{d}{m} \right)^{1/4},\] where $\lambda^{\theta}_i = m\int_{(\frac{i-1}{m}, \frac{i}{m}]} F_{ \langle X,\theta \rangle }^{-1}(u)\,du$ and $a^\sharp$ denotes the monotone non-decreasing rearrangement of $a$. Moreover, this estimate is optimal. The proof follows from a sharp estimate on the worst Wasserstein distance between a marginal of $X$ and its empirical counterpart, $\frac{1}{m} \sum_{i=1}^m \delta_{\langle X_i, \theta \rangle}$.


title: Convergence of Policy Iteration for Entropy-Regularized Stochastic Control Problems

abstract: For a general entropy-regularized stochastic control problem on an infinite horizon, we prove that a policy iteration algorithm (PIA) converges to an optimal relaxed control. Contrary to the standard stochastic control literature, classical H\"{o}lder estimates of value functions do not ensure the convergence of the PIA, due to the added entropy-regularizing term. To circumvent this, we carry out a delicate estimation by moving back and forth between appropriate H\"{o}lder and Sobolev spaces. This requires new Sobolev estimates designed specifically for the purpose of policy iteration and a nontrivial technique to contain the entropy growth. Ultimately, we obtain a uniform H\"{o}lder bound for the sequence of value functions generated by the PIA, thereby achieving the desired convergence result. Characterization of the optimal value function as the unique solution to an exploratory Hamilton-Jacobi-Bellman equation comes as a by-product. The PIA is numerically implemented in an example of optimal consumption.


title: MIPI 2022 Challenge on Quad-Bayer Re-mosaic: Dataset and Report

abstract: Developing and integrating advanced image sensors with novel algorithms in camera systems are prevalent with the increasing demand for computational photography and imaging on mobile platforms. However, the lack of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). To bridge the gap, we introduce the first MIPI challenge, including five tracks focusing on novel image sensors and imaging algorithms. In this paper, Quad Joint Remosaic and Denoise, one of the five tracks, working on the interpolation of Quad CFA to Bayer at full resolution, is introduced. The participants were provided a new dataset, including 70 (training) and 15 (validation) scenes of high-quality Quad and Bayer pairs. In addition, for each scene, Quad of different noise levels was provided at 0dB, 24dB, and 42dB. All the data were captured using a Quad sensor in both outdoor and indoor conditions. The final results are evaluated using objective metrics, including PSNR, SSIM, LPIPS, and KLD. A detailed description of all models developed in this challenge is provided in this paper. More details of this challenge and the link to the dataset can be found at https://github.com/mipi-challenge/MIPI2022.


title: PROB-SLAM: Real-time Visual SLAM Based on Probabilistic Graph Optimization

abstract: Traditional SLAM algorithms are typically based on artificial features, which lack high-level information. By introducing semantic information, SLAM can own higher stability and robustness rather than purely hand-crafted features. However, the high uncertainty of semantic detection networks prohibits the practical functionality of high-level information. To solve the uncertainty property introduced by semantics, this paper proposed a novel probability map based on the Gaussian distribution assumption. This map transforms the semantic binary object detection into probability results, which help establish a probabilistic data association between artificial features and semantic info. Through our algorithm, the higher confidence will be given higher weights in each update step while the edge of the detection area will be endowed with lower confidence. Then the uncertainty is undermined and has less effect on nonlinear optimization. The experiments are carried out in the TUM RGBD dataset, results show that our system improves ORB-SLAM2 by about 15% in indoor environments' errors. We have demonstrated that the method can be successfully applied to environments containing dynamic objects.


title: Optimal control for maximally creating and maintaining a superposition state of a two-level system under the influence of Markovian decoherence

abstract: Reducing decoherence is an essential step toward realizing general-purpose quantum computers beyond the present noisy intermediate-scale quantum (NISQ) computers. To this end, dynamical decoupling (DD) approaches in which external fields are applied to qubits are often adopted. We numerically study DD using a two-level model system (qubit) under the influence of Markovian decoherence by using quantum optimal control theory with slightly modified settings, in which the physical objective is to maximally create and maintain a specified superposition state in a specified control period. An optimal pulse is numerically designed while systematically varying the values of dephasing, population decay, pulse fluence, and control period as well as using two kinds of objective functionals. Although the decrease in purity due to the decoherence gives rise to the upper limit of the target expectation value, i.e., the saturated value, the optimally shaped pulse effectively deals with the decoherence by gradually creating the target superposition state to realize the saturated value as much as possible.


title: GAGA: Deciphering Age-path of Generalized Self-paced Regularizer

abstract: Nowadays self-paced learning (SPL) is an important machine learning paradigm that mimics the cognitive process of humans and animals. The SPL regime involves a self-paced regularizer and a gradually increasing age parameter, which plays a key role in SPL but where to optimally terminate this process is still non-trivial to determine. A natural idea is to compute the solution path w.r.t. age parameter (i.e., age-path). However, current age-path algorithms are either limited to the simplest regularizer, or lack solid theoretical understanding as well as computational efficiency. To address this challenge, we propose a novel \underline{G}eneralized \underline{Ag}e-path \underline{A}lgorithm (GAGA) for SPL with various self-paced regularizers based on ordinary differential equations (ODEs) and sets control, which can learn the entire solution spectrum w.r.t. a range of age parameters. To the best of our knowledge, GAGA is the first exact path-following algorithm tackling the age-path for general self-paced regularizer. Finally the algorithmic steps of classic SVM and Lasso are described in detail. We demonstrate the performance of GAGA on real-world datasets, and find considerable speedup between our algorithm and competing baselines.


title: SecSkyline: Fast Privacy-Preserving Skyline Queries over Encrypted Cloud Databases

abstract: The well-known benefits of cloud computing have spurred the popularity of database service outsourcing, where one can resort to the cloud to conveniently store and query databases. Coming with such popular trend is the threat to data privacy, as the cloud gains access to the databases and queries which may contain sensitive information, like medical or financial data. A large body of work has been presented for querying encrypted databases, which has been mostly focused on secure keyword search. In this paper, we instead focus on the support for secure skyline query processing over encrypted outsourced databases, where little work has been done. Skyline query is an advanced kind of database query which is important for multi-criteria decision-making systems and applications. We propose SecSkyline, a new system framework building on lightweight cryptography for fast privacy-preserving skyline queries. SecSkyline ambitiously provides strong protection for not only the content confidentiality of the outsourced database, the query, and the result, but also for data patterns that may incur indirect data leakages, such as dominance relationships among data points and search access patterns. Extensive experiments demonstrate that SecSkyline is substantially superior to the state-of-the-art in query latency, with up to 813$\times$ improvement.


title: CommunityLM: Probing Partisan Worldviews from Language Models

abstract: As political attitudes have diverged ideologically in the United States, political speech has diverged lingusitically. The ever-widening polarization between the US political parties is accelerated by an erosion of mutual understanding between them. We aim to make these communities more comprehensible to each other with a framework that probes community-specific responses to the same survey questions using community language models CommunityLM. In our framework we identify committed partisan members for each community on Twitter and fine-tune LMs on the tweets authored by them. We then assess the worldviews of the two groups using prompt-based probing of their corresponding LMs, with prompts that elicit opinions about public figures and groups surveyed by the American National Election Studies (ANES) 2020 Exploratory Testing Survey. We compare the responses generated by the LMs to the ANES survey results, and find a level of alignment that greatly exceeds several baseline methods. Our work aims to show that we can use community LMs to query the worldview of any group of people given a sufficiently large sample of their social media discussions or media diet.


title: A Lattice-Based Embedding Method for Reversible Audio Watermarking

abstract: Reversible audio watermarking (RAW) is a promising technique in various applications. To simultaneously meet the demand of achieving high imperceptibility and robustness, this paper proposes a novel RAW scheme based on lattices. The scheme is referred to as Meet-in-the-Middle Embedding (MME), in which the lattice quantization errors are properly scaled and added back to the quantized host signals. Simulations show that MME excels in a wide range of metrics including signal-to-watermark ratio (SWR), objective difference grade (ODG), and bit error rate (BER).


title: Efficient learning of nonlinear prediction models with time-series privileged information

abstract: In domains where sample sizes are limited, efficient learning algorithms are critical. Learning using privileged information (LuPI) offers increased sample efficiency by allowing prediction models access to auxiliary information at training time which is unavailable when the models are used. In recent work, it was shown that for prediction in linear-Gaussian dynamical systems, a LuPI learner with access to intermediate time series data is never worse and often better in expectation than any unbiased classical learner. We provide new insights into this analysis and generalize it to nonlinear prediction tasks in latent dynamical systems, extending theoretical guarantees to the case where the map connecting latent variables and observations is known up to a linear transform. In addition, we propose algorithms based on random features and representation learning for the case when this map is unknown. A suite of empirical results confirm theoretical findings and show the potential of using privileged time-series information in nonlinear prediction.


title: uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers

abstract: The task of Chinese Spelling Check (CSC) is aiming to detect and correct spelling errors that can be found in the text. While manually annotating a high-quality dataset is expensive and time-consuming, thus the scale of the training dataset is usually very small (e.g., SIGHAN15 only contains 2339 samples for training), therefore supervised-learning based models usually suffer the data sparsity limitation and over-fitting issue, especially in the era of big language models. In this paper, we are dedicated to investigating the \textbf{unsupervised} paradigm to address the CSC problem and we propose a framework named \textbf{uChecker} to conduct unsupervised spelling error detection and correction. Masked pretrained language models such as BERT are introduced as the backbone model considering their powerful language diagnosis capability. Benefiting from the various and flexible MASKing operations, we propose a Confusionset-guided masking strategy to fine-train the masked language model to further improve the performance of unsupervised detection and correction. Experimental results on standard datasets demonstrate the effectiveness of our proposed model uChecker in terms of character-level and sentence-level Accuracy, Precision, Recall, and F1-Measure on tasks of spelling error detection and correction respectively.


title: Active Self-Training for Weakly Supervised 3D Scene Semantic Segmentation

abstract: Since the preparation of labeled data for training semantic segmentation networks of point clouds is a time-consuming process, weakly supervised approaches have been introduced to learn from only a small fraction of data. These methods are typically based on learning with contrastive losses while automatically deriving per-point pseudo-labels from a sparse set of user-annotated labels. In this paper, our key observation is that the selection of what samples to annotate is as important as how these samples are used for training. Thus, we introduce a method for weakly supervised segmentation of 3D scenes that combines self-training with active learning. The active learning selects points for annotation that likely result in performance improvements to the trained model, while the self-training makes efficient use of the user-provided labels for learning the model. We demonstrate that our approach leads to an effective method that provides improvements in scene segmentation over previous works and baselines, while requiring only a small number of user annotations.


title: Fixed-Point Centrality for Networks

abstract: This paper proposes a family of network centralities called fixed-point centralities. This centrality family is defined via the fixed point of permutation equivariant mappings related to the underlying network. Such a centrality notion is immediately extended to define fixed-point centralities for infinite graphs characterized by graphons. Variation bounds of such centralities with respect to the variations of the underlying graphs and graphons under mild assumptions are established. Fixed-point centralities connect with a variety of different models on networks including graph neural networks, static and dynamic games on networks, and Markov decision processes.


title: Noise2Astro: Astronomical Image Denoising With Self-Supervised NeuralNetworks

abstract: In observational astronomy, noise obscures signals of interest. Large-scale astronomical surveys are growing in size and complexity, which will produce more data and increase the workload of data processing. Developing automated tools, such as convolutional neural networks (CNN), for denoising has become a promising area of research. We investigate the feasibility of CNN-based self-supervised learning algorithms (e.g., Noise2Noise) for denoising astronomical images. We experimented with Noise2Noise on simulated noisy astronomical data. We evaluate the results based on the accuracy of recovering flux and morphology. This algorithm can well recover the flux for Poisson noise ( $98.13${\raisebox{0.5ex}{\tiny$^{+0.77}_{-0.90} $}$\large\%$}) and for Gaussian noise when image data has a smooth signal profile ($96.45${\raisebox{0.5ex}{\tiny$^{+0.80}_{-0.96} $}$\large\%$}).


title: Anderson localization transitions in disordered non-Hermitian systems with exceptional points

abstract: The critical exponents of continuous phase transitions of a Hermitian system depend on and only on its dimensionality and symmetries. This is the celebrated notion of the universality of continuous phase transitions. Here we report the superuniversality notion of Anderson localization transitions in non-Hermitian two-dimensional (2D) systems with exceptional points in which the critical exponents do not depend on the symmetries. The Anderson localization transitions are numerically studied by using the finite-size scaling analysis of the participation ratios. At the exceptional points of either second-order or fourth-order, two non-Hermitian systems with different symmetries have the same critical exponent $\nu\simeq 2$ of correlation lengths. This value differs from all known 2D disordered Hermitian and non-Hermitian systems. In the symmetry-preserved and symmetry-broken phases, the non-Hermitian models with time-reversal symmetry and without spin-rotational symmetry (without time-reversal and spin-rotational symmetries) are in the same universality class of 2D Hermitian electron systems of Gaussian symplectic (unitary) ensemble, where $\nu\simeq 2.7$ ($\nu\simeq 2.3$). The universality of the transition is further confirmed by showing that the critical exponent $\nu$ does not depend on the form of disorders and boundary conditions. Our results suggest that non-Hermitian systems of different symmetries around their exceptional points form a superuniversality class.


title: Analyses of the collective properties of hadronic matter in Au-Au collisions at 54.4 GeV

abstract: We investigated the strange hadrons transverse momentum ($p_T$) spectra in Au-Au collision at $\sqrt {s_{NN}}$ = 54.4 GeV in the framework of modified Hagedorn function with embedded flow. We extracted the kinetic freeze-out temperature $T_0$, transverse flow velocity $\beta_T$, kinetic freeze-out volume $V$, mean transverse momentum $<p_T>$, the entropy parameter $n$ and the multiplicity parameter $N_0$. We reported that all these parameters increase towards the central collisions. The larger kinetic freeze-out temperature , transverse flow velocity, kinetic freeze-out volume and the entropy parameter (n) in central collisions compared to peripheral collisions show the early decoupling of the particles in central collisions. In addition, all the above parameters are mass dependent. The kinetic freeze-out temperature ($T_0$), the entropy parameter $n$ and mean transverse momentum ($<p_T>$) are larger for massive particles, while the transverse flow velocity ($\beta_T$), kinetic freeze-out volume ($V$) and the multiplicity parameter ($N_0$) show the opposite behavior. Larger $T_0$, $n$ and smaller $\beta_T$ as well as $V$ of the heavier particles indicates the early freeze-out of the heavier particles, while larger $<p_T>$ for the heavier particles evince that the effect of radial flow is stronger in heavier particles. The separate set of parameters for each particle shows the multiple kinetic freeze-out scenario, where the mass dependent kinetic freeze-out volume shows the volume differential freeze-out scenario. We also checked the correlation among different parameters, which include the correlation of $T_0$ and $\beta_T$, $T_0$ and $V$, $\beta_T$ and $V$, $<p_T>$ and $T_0$, $<p_T>$ and $\beta_T$, $<p_T>$ and $V$, $n$ and $T_0$, $n$ and $\beta_T$, and $n$ and $V$, and they all are observed to have positive correlations with each other which validates our results.


title: On the Reuse Bias in Off-Policy Reinforcement Learning

abstract: Importance sampling (IS) is a popular technique in off-policy evaluation, which re-weights the return of trajectories in the replay buffer to boost sample efficiency. However, training with IS can be unstable and previous attempts to address this issue mainly focus on analyzing the variance of IS. In this paper, we reveal that the instability is also related to a new notion of Reuse Bias of IS -- the bias in off-policy evaluation caused by the reuse of the replay buffer for evaluation and optimization. We theoretically show that the off-policy evaluation and optimization of the current policy with the data from the replay buffer result in an overestimation of the objective, which may cause an erroneous gradient update and degenerate the performance. We further provide a high-probability upper bound of the Reuse Bias, and show that controlling one term of the upper bound can control the Reuse Bias by introducing the concept of stability for off-policy algorithms. Based on these analyses, we finally present a novel Bias-Regularized Importance Sampling (BIRIS) framework along with practical algorithms, which can alleviate the negative impact of the Reuse Bias. Experimental results show that our BIRIS-based methods can significantly improve the sample efficiency on a series of continuous control tasks in MuJoCo.


title: Bi-level Physics-Informed Neural Networks for PDE Constrained Optimization using Broyden's Hypergradients

abstract: Deep learning based approaches like Physics-informed neural networks (PINNs) and DeepONets have shown promise on solving PDE constrained optimization (PDECO) problems. However, existing methods are insufficient to handle those PDE constraints that have a complicated or nonlinear dependency on optimization targets. In this paper, we present a novel bi-level optimization framework to resolve the challenge by decoupling the optimization of the targets and constraints. For the inner loop optimization, we adopt PINNs to solve the PDE constraints only. For the outer loop, we design a novel method by using Broyden's method based on the Implicit Function Theorem (IFT), which is efficient and accurate for approximating hypergradients. We further present theoretical explanations and error analysis of the hypergradients computation. Extensive experiments on multiple large-scale and nonlinear PDE constrained optimization problems demonstrate that our method achieves state-of-the-art results compared with strong baselines.


title: Responsible AI Implementation: A Human-centered Framework for Accelerating the Innovation Process

abstract: There is still a significant gap between expectations and the successful adoption of AI to innovate and improve businesses. Due to the emergence of deep learning, AI adoption is more complex as it often incorporates big data and the internet of things, affecting data privacy. Existing frameworks have identified the need to focus on human-centered design, combining technical and business/organizational perspectives. However, trust remains a critical issue that needs to be designed from the beginning. The proposed framework expands from the human-centered design approach, emphasizing and maintaining the trust that underpins the process. This paper proposes a theoretical framework for responsible artificial intelligence (AI) implementation. The proposed framework emphasizes a synergistic business technology approach for the agile co-creation process. The aim is to streamline the adoption process of AI to innovate and improve business by involving all stakeholders throughout the project so that the AI technology is designed, developed, and deployed in conjunction with people and not in isolation. The framework presents a fresh viewpoint on responsible AI implementation based on analytical literature review, conceptual framework design, and practitioners' mediating expertise. The framework emphasizes establishing and maintaining trust throughout the human-centered design and agile development of AI. This human-centered approach is aligned with and enabled by the privacy by design principle. The creators of the technology and the end-users are working together to tailor the AI solution specifically for the business requirements and human characteristics. An illustrative case study on adopting AI for assisting planning in a hospital will demonstrate that the proposed framework applies to real-life applications.


title: Scrutinizing the relationship between plage areas and sunspot areas and numbers

abstract: Studies and reconstructions of past solar activity require data on sunspots as well as faculae/plage and network. Such data are also important for understanding the magnetic activity and variability of the Sun and Sun-like stars. The longest available direct faculae/plage datasets are white-light facular and Ca II K observations going back to 1874 and 1892, respectively. Prior to that time, the only direct data available are for sunspots. We reassess the relationship between plage areas and sunspot records (areas and numbers) since 1892, to allow reconstructions of facular/plage areas which can be employed for studies going further back in time, i.e. over the period when solely sunspot observations are available. We use the plage areas derived from 38 consistently processed Ca II K archives as well as the plage area composite based on these archives. We find the relationship between plage and sunspot areas and numbers to be well represented by a power law function. We further find that the relationships depend on the bandwidth and the solar cycle strength. The reconstructions with a power law relationship are in good agreement with the original plage area series, whereas employment of a cycle-strength-dependent relationship improves the reconstructions only marginally. Performing the same analysis on other previously published plage area series, usually derived from a single archive with diverse processing techniques, returns different results when using different time series. This highlights the importance of applying a consistent processing to the various archives and demonstrates the uncertainties introduced by using previously published series. Our results have implications for past solar activity and irradiance reconstructions as well as for stellar activity studies, which sometimes assume a linear dependence between plage and sunspot areas.


title: Advantages of optical modulation in terahertz imaging for study of graphene layers

abstract: It was demonstrated that optical modulation together with simultaneous terahertz (THz) imaging application enables an increase in contrast by an order of magnitude illustrating hence the technique as convenient contactless tool for characterization of graphene deposited on high-resistivity silicon substrates. It was shown that the single- and double-layer graphene can be discriminated and characterized via variation of THz image contrast using a discrete frequency in a continuous wave mode. Modulation depth of 45 % has been reached, the contrast variation from 0.16 up to 0.23 is exposed under laser illumination for the single and double layer graphene, respectively. The technique was applied in the development and investigation of graphene-based optical diffractive elements for THz imaging systems.


title: Nonparametric inference for additive models estimated via simplified smooth backfitting

abstract: We investigate hypothesis testing in nonparametric additive models estimated using simplified smooth backfitting (Huang and Yu, Journal of Computational and Graphical Statistics, \textbf{28(2)}, 386--400, 2019). Simplified smooth backfitting achieves oracle properties under regularity conditions and provides closed-form expressions of the estimators that are useful for deriving asymptotic properties. We develop a generalized likelihood ratio (GLR) and a loss function (LF) based testing framework for inference. Under the null hypothesis, both the GLR and LF tests have asymptotically rescaled chi-squared distributions, and both exhibit the Wilks phenomenon, which means the scaling constants and degrees of freedom are independent of nuisance parameters. These tests are asymptotically optimal in terms of rates of convergence for nonparametric hypothesis testing. Additionally, the bandwidths that are well-suited for model estimation may be useful for testing. We show that in additive models, the LF test is asymptotically more powerful than the GLR test. We use simulations to demonstrate the Wilks phenomenon and the power of these proposed GLR and LF tests, and a real example to illustrate their usefulness.


title: Layerwise Bregman Representation Learning with Applications to Knowledge Distillation

abstract: In this work, we propose a novel approach for layerwise representation learning of a trained neural network. In particular, we form a Bregman divergence based on the layer's transfer function and construct an extension of the original Bregman PCA formulation by incorporating a mean vector and normalizing the principal directions with respect to the geometry of the local convex function around the mean. This generalization allows exporting the learned representation as a fixed layer with a non-linearity. As an application to knowledge distillation, we cast the learning problem for the student network as predicting the compression coefficients of the teacher's representations, which are passed as the input to the imported layer. Our empirical findings indicate that our approach is substantially more effective for transferring information between networks than typical teacher-student training using the teacher's penultimate layer representations and soft labels.


title: DEQGAN: Learning the Loss Function for PINNs with Generative Adversarial Networks

abstract: Solutions to differential equations are of significant scientific and engineering relevance. Physics-Informed Neural Networks (PINNs) have emerged as a promising method for solving differential equations, but they lack a theoretical justification for the use of any particular loss function. This work presents Differential Equation GAN (DEQGAN), a novel method for solving differential equations using generative adversarial networks to "learn the loss function" for optimizing the neural network. Presenting results on a suite of twelve ordinary and partial differential equations, including the nonlinear Burgers', Allen-Cahn, Hamilton, and modified Einstein's gravity equations, we show that DEQGAN can obtain multiple orders of magnitude lower mean squared errors than PINNs that use $L_2$, $L_1$, and Huber loss functions. We also show that DEQGAN achieves solution accuracies that are competitive with popular numerical methods. Finally, we present two methods to improve the robustness of DEQGAN to different hyperparameter settings.


title: Neutrino forces in neutrino backgrounds

abstract: The Standard Model predicts a long-range force, proportional to $G_F^2/r^5$, between fermions due to the exchange of a pair of neutrinos. This quantum force is feeble and has not been observed yet. In this paper, we compute this force in the presence of neutrino backgrounds, both for isotropic and directional background neutrinos. We find that for the case of directional background the force can have a $1/r$ dependence and it can be significantly enhanced compared to the vacuum case. In particular, background effects caused by reactor, solar, and supernova neutrinos enhance the force by many orders of magnitude. The enhancement, however, occurs only in the direction parallel to the direction of the background neutrinos. We discuss the experimental prospects of detecting the neutrino force in neutrino backgrounds and find that the effect is close to the available sensitivity of the current fifth force experiments. Yet, the angular spread of the neutrino flux and that of the test masses reduce the strength of this force. The results are encouraging and a detailed experimental study is called for to check if the effect can be probed.


title: Fermions tunneling of Kerr-Newman-de Sitter black hole in Lorentz violation theory

abstract: In this paper, the tunneling of fermions near the event horizon of Kerr-Newman-de Sitter black hole is investigated in frame dragging coordinate systems, Eddington coordinate system and Painleve coordinate system by using Dirac equation with Lorentz violation theory, Feynman prescription and WKB approximation. The Hawking temperature, heat capacity and change in Bekenstein-Hawking entropy are modified due to presence of Lorentz violation theory. The modified Hawking temperatures, heat capacities and change in Bekenstein-Hawking entropies near the event horizon of Kerr-Newman-de Sitter black hole would increase or decrease depending upon the choices of ether like vectors $u^{\alpha}$. In the absence of Lorentz violation theory, the original Hawking temperature, entropy and heat capacity are recovered.