title: InfoPrint: Embedding Information into 3D Printed Objects

abstract: We present a technique to embed information invisible to the eye inside 3D printed objects. The information is integrated in the object model, and then fabricated using off-the-shelf dual-head FDM (Fused Deposition Modeling) 3D printers. Our process does not require human intervention during or after printing with the integrated model. The information can be arbitrary symbols, such as icons, text,binary, or handwriting. To retrieve the information, we evaluate two different infrared-based imaging devices that are readily available-thermal cameras and near-infrared scanners. Based on our results, we propose design guidelines for a range of use cases to embed and extract hidden information. We demonstrate how our method can be used for different applications, such as interactive thermal displays, hidden board game tokens, tagging functional printed objects, and autographing non-fungible fabrication work.


title: Is the use of Deep Learning and Artificial Intelligence an appropriate means to locate debris in the ocean without harming aquatic wildlife?

abstract: With the global issue of plastic debris ever expanding, it is about time that the technology industry stepped in. This study aims to assess whether deep learning can successfully distinguish between marine life and man-made debris underwater. The aim is to find if we are safely able to clean up our oceans with Artificial Intelligence without disrupting the delicate balance of the aquatic ecosystems. The research explores the use of Convolutional Neural Networks from the perspective of protecting the ecosystem, rather than primarily collecting rubbish. We did this by building a custom-built, deep learning model, with an original database including 1,644 underwater images and used a binary classification to sort synthesised material from aquatic life. We concluded that although it is possible to safely distinguish between debris and life, further exploration with a larger database and stronger CNN structure has the potential for much more promising results.


title: An Improved Regularity Criterion and Absence of Splash-like Singularities for g-SQG Patches

abstract: We prove that splash-like singularities cannot occur for sufficiently regular patch solutions to the generalized surface quasi-geostrophic equation on the plane or half-plane with parameter $\alpha\le \frac 14$. This includes potential touches of more than two patch boundary segments in the same location, an eventuality that has not been excluded previously and presents nontrivial complications (in fact, if we do a priori exclude it, then our results extend to all $\alpha\in(0,1)$). As a corollary, we obtain an improved global regularity criterion for $H^3$ patch solutions when $\alpha\le\frac 14$, namely that finite time singularities cannot occur while the $H^3$ norms of patch boundaries remain bounded.


title: Stabilizing amplifier with a programmable load line for characterization of nanodevices with negative differential resistance

abstract: Resistive switching devices and other components with negative differential resistance (NDR) are emerging as possible electronic constituents of next-generation computing architectures. Due to the NDR effects exhibited, switching operations are strongly affected by the presence of resistance in series with the memory cell. Experimental measurements useful in the development of these devices use a deliberate addition of series resistance, which can be done either by integrating resistors on-chip or by connecting external components to the wafer probing system. The former approach is considered inflexible because the resistance value attached to a given device cannot be changed or removed, while the latter approach tends to create parasitic effects that impact controllability and interfere with measurements. In this work we introduce a circuit design for flexible characterization of two-terminal nanodevices that provides a programmatically adjustable external series resistance while maintaining low parasitic capacitance. Experimental demonstrations are given that show the impact of the series resistance on NDR and resistive switching measurements.


title: Public Data-Assisted Mirror Descent for Private Model Training

abstract: In this paper, we revisit the problem of using in-distribution public data to improve the privacy/utility trade-offs for differentially private (DP) model training. (Here, public data refers to auxiliary data sets that have no privacy concerns.) We design a natural variant of DP mirror descent, where the DP gradients of the private/sensitive data act as the linear term, and the loss generated by the public data as the mirror map. We show that, for linear regression with feature vectors drawn from a non-isotropic sub-Gaussian distribution, our algorithm, PDA-DPMD (a variant of mirror descent), provides population risk guarantees that are asymptotically better than the best known guarantees under DP (without having access to public data), when the number of public data samples ($n_{\sf pub}$) is sufficiently large. We further show that our algorithm has natural "noise stability" properties that control the variance due to noise added to ensure DP. We demonstrate the efficacy of our algorithm by showing privacy/utility trade-offs on four benchmark datasets (StackOverflow, WikiText-2, CIFAR-10, and EMNIST). We show that our algorithm not only significantly improves over traditional DP-SGD, which does not have access to public data, but to our knowledge is the first to improve over DP-SGD on models that have been pre-trained with public data.


title: Optical analogue of the Schwarzschild-Planck metric

abstract: We revisit the connection between trajectories of accelerated mirrors and spacetime metrics. We present the general (1+1)D effective metric that can be obtained with a fibre-optical analogue through the Kerr effect. Then we introduce a new connection between accelerated mirrors and the optical metric. In particular, we connect them for two specific trajectories: The first one is the black mirror that perfectly recreates the Schwarzchild spacetime. The second one is the Schwarzschild-Planck metric that is a regularized version of the Schwarzschild case. The regularization depends on a length scale that has a clear physical interpretation in the fibre-optical analogue system. We study the geometric properties and the Hawking radiation produced in these new analogue metrics.


title: Efficient Online Bayesian Inference for Neural Bandits

abstract: In this paper we present a new algorithm for online (sequential) inference in Bayesian neural networks, and show its suitability for tackling contextual bandit problems. The key idea is to combine the extended Kalman filter (which locally linearizes the likelihood function at each time step) with a (learned or random) low-dimensional affine subspace for the parameters; the use of a subspace enables us to scale our algorithm to models with $\sim 1M$ parameters. While most other neural bandit methods need to store the entire past dataset in order to avoid the problem of "catastrophic forgetting", our approach uses constant memory. This is possible because we represent uncertainty about all the parameters in the model, not just the final linear layer. We show good results on the "Deep Bayesian Bandit Showdown" benchmark, as well as MNIST and a recommender system.


title: Luminescence from ZAIS quantum dots: radiative or nonradiative

abstract: Quantum dots have found applications across the semiconductor and biotechnology industries, improving energy efficiency, color purity, and imaging capability. However, the standard quantum dot relies on a heavy metal architecture, which has undesirable environmental impacts. Thus, alternative material systems are desirable. One strategy is the ZnS-AgInS2 (ZAIS) quantum dot which has a metal dichalcogenide chemical structure. Unlike heavy metal quantum dots, these nanoparticles luminesce even when defects are present, and their emission wavelength is tuned by varying the relative composition. Past works have linked the source of this luminescence to a defect-assisted transition recombination process, but the precise mechanism is still unclear. In this work, we investigate the physics of this defect-assisted transition by systematically varying the concentration of defects through a simple quick-cool thermal annealing process which provides control over the crystalline disorder of the nanoparticle. Using a combination of ultraviolet photoelectron spectroscopy and fluorescence measurements, information about the nature of the defect-assisted transition is obtained. In contrast to previous work, we find that the ZAIS quantum dot luminescence has an electronic-based rather than defect-assisted transition mechanism.


title: Evolving Antennas for Ultra-High Energy Neutrino Detection

abstract: Evolutionary algorithms are a type of artificial intelligence that utilize principles of evolution to efficiently determine solutions to defined problems. These algorithms are particularly powerful at finding solutions that are too complex to solve with traditional techniques and at improving solutions found with simplified methods. The GENETIS collaboration is developing genetic algorithms to design antennas that are more sensitive to ultra high energy neutrino induced radio pulses than current detectors. Improving antenna sensitivity is critical because UHE neutrinos are rare and require massive detector volumes with stations dispersed over hundreds of km squared. The GENETIS algorithm evolves antenna designs using simulated neutrino sensitivity as a measure of fitness by integrating with XFdtd, a finite difference time domain modeling program, and with simulations of neutrino experiments. The best antennas will then be deployed in ice for initial testing. The genetic algorithm's aim is to create antennas that improve on the designs used in the existing ARA experiment by more than a factor of 2 in neutrino sensitivities. This research could improve antenna sensitivities in future experiments and thus accelerate the discovery of UHE neutrinos. This is the first time that antennas have been designed using genetic algorithms with a fitness score based on a physics outcome, which will motivate the continued use of genetic algorithm designed instrumentation in astrophysics and beyond. This proceeding will report on advancements to the algorithm, steps taken to improve the genetic algorithm performance, the latest results from our evolutions, and the manufacturing road map.


title: TOI-1842b: A Transiting Warm Saturn Undergoing Re-Inflation around an Evolving Subgiant

abstract: The imminent launch of space telescopes designed to probe the atmospheres of exoplanets has prompted new efforts to prioritise the thousands of transiting planet candidates for follow-up characterisation. We report the detection and confirmation of TOI-1842b, a warm Saturn identified by TESS and confirmed with ground-based observations from Minerva-Australis, NRES, and the Las Cumbres Observatory Global Telescope. This planet has a radius of $1.04^{+0.06}_{-0.05}\,R_{Jup}$, a mass of $0.214^{+0.040}_{-0.038}\,M_{Jup}$, an orbital period of $9.5739^{+0.0002}_{-0.0001}$ days, and an extremely low density ($\rho$=0.252$\pm$0.091 g cm$^{-3}$). TOI-1842b has among the best known combinations of large atmospheric scale height (893 km) and host-star brightness ($J=8.747$ mag), making it an attractive target for atmospheric characterisation. As the host star is beginning to evolve off the main sequence, TOI-1842b presents an excellent opportunity to test models of gas giant re-inflation. The primary transit duration of only 4.3 hours also makes TOI-1842b an easily-schedulable target for further ground-based atmospheric characterisation.


title: From Quantum Codes to Gravity: A Journey of Gravitizing Quantum Mechanics

abstract: In this note, I review a recent approach to quantum gravity that "gravitizes" quantum mechanics by emerging geometry and gravity from complex quantum states. Drawing further insights from tensor network toy models in AdS/CFT, I propose that approximate quantum error correction codes, when re-adapted into the aforementioned framework, also has promise in emerging gravity in near-flat geometries.


title: Efficient Big Text Data Clustering Algorithms using Hadoop and Spark

abstract: Document clustering is a traditional, efficient and yet quite effective, text mining technique when we need to get a better insight of the documents of a collection that could be grouped together. The K-Means algorithm and the Hierarchical Agglomerative Clustering (HAC) algorithm are two of the most known and commonly used clustering algorithms; the former due to its low time cost and the latter due to its accuracy. However, even the use of K-Means in text clustering over large-scale collections can lead to unacceptable time costs. In this paper we first address some of the most valuable approaches for document clustering over such 'big data' (large-scale) collections. We then present two very promising alternatives: (a) a variation of an existing K-Means-based fast clustering technique (known as BigKClustering - BKC) so that it can be applied in document clustering, and (b) a hybrid clustering approach based on a customized version of the Buckshot algorithm, which first applies a hierarchical clustering procedure on a sample of the input dataset and then it uses the results as the initial centers for a K-Means based assignment of the rest of the documents, with very few iterations. We also give highly efficient adaptations of the proposed techniques in the MapReduce model which are then experimentally tested using Apache Hadoop and Spark over a real cluster environment. As it comes out of the experiments, they both lead to acceptable clustering quality as well as to significant time improvements (compared to K-Means - especially the Buckshot-based algorithm), thus constituting very promising alternatives for big document collections.


title: Spectral Characterization of PVDF Sensor Designs for Acoustic Spectroscopy

abstract: Polyvinylidene difluoride (PVDF) sensors are of interest to ultrasonic applications due to their high sensitivity and efficient acoustic coupling to the environment. PVDF sensors for scientific applications typically possess a flat frequency response to faithfully reproduce spectral components of an unknown source. However, in industrial sensing applications higher responsivity is desirable even at the cost of decreased flatness in the spectral responsivity. To better understand the trade-offs between intrinsic responsivity and spectral response we examine four PVDF sensor variants for spectral responsivity as a function of thickness and find that increased responsivity is correlated with a strong non-linear frequency dependence.


title: 3DVNet: Multi-View Depth Prediction and Volumetric Refinement

abstract: We present 3DVNet, a novel multi-view stereo (MVS) depth-prediction method that combines the advantages of previous depth-based and volumetric MVS approaches. Our key idea is the use of a 3D scene-modeling network that iteratively updates a set of coarse depth predictions, resulting in highly accurate predictions which agree on the underlying scene geometry. Unlike existing depth-prediction techniques, our method uses a volumetric 3D convolutional neural network (CNN) that operates in world space on all depth maps jointly. The network can therefore learn meaningful scene-level priors. Furthermore, unlike existing volumetric MVS techniques, our 3D CNN operates on a feature-augmented point cloud, allowing for effective aggregation of multi-view information and flexible iterative refinement of depth maps. Experimental results show our method exceeds state-of-the-art accuracy in both depth prediction and 3D reconstruction metrics on the ScanNet dataset, as well as a selection of scenes from the TUM-RGBD and ICL-NUIM datasets. This shows that our method is both effective and generalizes to new settings.


title: One-component quantum mechanics and dynamical leakage-free paths

abstract: We derive an exact one-component equation of motion for the probability amplitude of a target time-dependent state, and use the equation to reformulate quantum dynamics and control for both closed and open systems. Using the one-component equation, we show that an unexpected time-dependent leakage-free path can be induced and we capture the essential quantity in determining the effect of decoherence suppression. Our control protocol based on the nonperturbative leakage elimination operator provides a unified perspective connecting some subtle, popular and important concepts of quantum control, such as dynamical decoupling, quantum Zeno effect, and adiabatic passage. The resultant one-component equation will promise significant advantages in both quantum mechanics and control.


title: Entanglement between charge qubit states and coherent states of nanomechanical resonator generated by AC Josephson effect

abstract: We considered a nanoelectromechanical system consisting of a movable Cooper-pair box qubit which is subject to an electrostatic field, and coupled to the two bulk superconductors via tunneling processes. We suggest that qubit dynamics is related to the one of a quantum oscillator and demonstrate that a bias voltage applied between superconductors generates states represented by the entanglement of qubit states and coherent states of the oscillator if certain resonant conditions are fulfilled. It is shown that a structure of this entanglement may be controlled by the bias voltage in a way that gives rise to the entanglement incorporating so-called cat-states - the superposition of coherent states. We characterize the formation and development of such states analyzing the entropy of entanglement and corresponding Wigner function. The experimentally feasible detection of the effect by measuring the average current is also considered.


title: The Three F's for Bicategories I: Localization by Fractions is Exact

abstract: We study the interaction between the notions of filteredness, fractions and fibrations in the theory of bicategories, generalizing classical results for categories. We give an explicit formula for filtered pseudo-colimits of categories indexed by a bicategory, and we use it to compute the hom-categories of a bicategory of fractions. As a consequence, we show that the canonical pseudo-functor into a bicategory of fractions is exact.


title: Querying Labelled Data with Scenario Programs for Sim-to-Real Validation

abstract: Simulation-based testing of autonomous vehicles (AVs) has become an essential complement to road testing to ensure safety. Consequently, substantial research has focused on searching for failure scenarios in simulation. However, a fundamental question remains: are AV failure scenarios identified in simulation meaningful in reality, i.e., are they reproducible on the real system? Due to the sim-to-real gap arising from discrepancies between simulated and real sensor data, a failure scenario identified in simulation can be either a spurious artifact of the synthetic sensor data or an actual failure that persists with real sensor data. An approach to validate simulated failure scenarios is to identify instances of the scenario in a corpus of real data, and check if the failure persists on the real data. To this end, we propose a formal definition of what it means for a labelled data item to match an abstract scenario, encoded as a scenario program using the SCENIC probabilistic programming language. Using this definition, we develop a querying algorithm which, given a scenario program and a labelled dataset, finds the subset of data matching the scenario. Experiments demonstrate that our algorithm is accurate and efficient on a variety of realistic traffic scenarios, and scales to a reasonable number of agents.


title: Improved sparse PCA method for face and image recognition

abstract: Face recognition is the very significant field in pattern recognition area. It has multiple applications in military and finance, to name a few. In this paper, the combination of the sparse PCA with the nearest-neighbor method (and with the kernel ridge regression method) will be proposed and will be applied to solve the face recognition problem. Experimental results illustrate that the accuracy of the combination of the sparse PCA method (using the proximal gradient method and the FISTA method) and one specific classification system may be lower than the accuracy of the combination of the PCA method and one specific classification system but sometimes the combination of the sparse PCA method (using the proximal gradient method or the FISTA method) and one specific classification system leads to better accuracy. Moreover, we recognize that the process computing the sparse PCA algorithm using the FISTA method is always faster than the process computing the sparse PCA algorithm using the proximal gradient method.


title: Analyzing the effect of cell rearrangement on Delta-Notch pattern formation

abstract: The Delta-Notch system plays a vital role in a number of areas in biology and typically forms a salt and pepper pattern in which cells strongly expressing Delta and cells strongly expressing Notch are alternately aligned via lateral inhibition. Although the spatial arrangement of the cells is important to the Delta-Notch pattern, the effect of cell rearrangement is not often considered. In this study, we provide a framework to analytically evaluate the effect of cell mixing and proliferation on Delta-Notch pattern formation in one spatial dimension. We model cell rearrangement events by a Poisson process and analyze the model while preserving the discrete properties of the spatial structure. We find that the homogeneous expression pattern is stabilized if the frequency of cell rearrangement events is sufficiently large. We analytically obtain the critical frequencies of the cell rearrangement events where the decrease of the pattern amplitude as a result of cell rearrangement is balanced by the increase in amplitude due to the Delta-Notch interaction dynamics. Our theoretical results are qualitatively consistent with experimental results, supporting the notion that the heterogeneity of expression patterns is inversely correlated with cell rearrangement \textit{in vivo}. Our framework, while applied here to the specific case of the Delta-Notch system, is applicable more widely to other pattern formation mechanisms.


title: Environmental Sound Extraction Using Onomatopoeic Words

abstract: An onomatopoeic word, which is a character sequence that phonetically imitates a sound, is effective in expressing characteristics of sound such as duration, pitch, and timbre. We propose an environmental-sound-extraction method using onomatopoeic words to specify the target sound to be extracted. By this method, we estimate a time-frequency mask from an input mixture spectrogram and an onomatopoeic word using a U-Net architecture, then extract the corresponding target sound by masking the spectrogram. Experimental results indicate that the proposed method can extract only the target sound corresponding to the onomatopoeic word and performs better than conventional methods that use sound-event classes to specify the target sound.


title: Nanomechanics driven by the superconducting proximity effect

abstract: We consider a nanoelectromechanical weak link composed of a carbon nanotube suspended above a trench in a normal metal electrode and positioned in a gap between two superconducting leads. The nanotube is treated as a movable single-level quantum dot in which the position-dependent superconducting order parameter is induced as a result of Cooper pair tunneling. We show that in such a system, self-sustained bending vibrations can emerge if a bias voltage is applied. The occurrence of this effect crucially depends on the direction of the bias voltage and the relative position of the quantum dot level. We also demonstrate that the nanotube vibrations strongly affect the dc current through the system, a characteristic that can be used for the direct experimental observation of the predicted phenomenon.


title: Filters and compactness on small categories and locales

abstract: In analogy with the classical theory of filters, for fi\-nite\-ly complete or small cat\-e\-go\-ries, we provide the concepts of fil\-ter, $\mathfrak{G}$-neigh\-bor\-hood (short for "Grothendieck-neigh\-bor\-hood") and cover-neigh\-bor\-hood of points of such categories, with the goal of studying convergence, cluster point, closure of sieves and compactness on objects of that kind of categories. Finally, we study all these concepts in the category $\bf{Loc}$ of locales.


title: A quantum parallel Markov chain Monte Carlo

abstract: We propose a novel hybrid quantum computing strategy for parallel MCMC algorithms that generate multiple proposals at each step. This strategy makes the rate-limiting step within parallel MCMC amenable to quantum parallelization by using the Gumbel-max trick to turn the generalized accept-reject step into a discrete optimization problem. When combined with new insights from the parallel MCMC literature, such an approach allows us to embed target density evaluations within a well-known extension of Grover's quantum search algorithm. Letting $P$ denote the number of proposals in a single MCMC iteration, the combined strategy reduces the number of target evaluations required from $\mathcal{O}(P)$ to $\mathcal{O}(P^{1/2})$. In the following, we review the rudiments of quantum computing, quantum search and the Gumbel-max trick in order to elucidate their combination for as wide a readership as possible.


title: Minimax Analysis for Inverse Risk in Nonparametric Planer Invertible Regression

abstract: We study a minimax risk of estimating inverse functions on a plane, while keeping an estimator is also invertible. Learning invertibility from data and exploiting an invertible estimator are used in many domains, such as statistics, econometrics, and machine learning. Although the consistency and universality of invertible estimators have been well investigated, analysis of the efficiency of these methods is still under development. In this study, we study a minimax risk for estimating invertible bi-Lipschitz functions on a square in a $2$-dimensional plane. We first introduce two types of $L^2$-risks to evaluate an estimator which preserves invertibility. Then, we derive lower and upper rates for minimax values for the risks associated with inverse functions. For the derivation, we exploit a representation of invertible functions using level-sets. Specifically, to obtain the upper rate, we develop an estimator asymptotically almost everywhere invertible, whose risk attains the derived minimax lower rate up to logarithmic factors. The derived minimax rate corresponds to that of the non-invertible bi-Lipschitz function, which shows that the invertibility does not reduce the complexity of the estimation problem in terms of the rate. % the minimax rate, similar to other shape constraints.


title: Discrete-modulation continuous-variable quantum key distribution with high key rate

abstract: Discrete-modulation continuous-variable quantum key distribution has the potential for large-scale deployment in the secure quantum communication networks due to low implementation complexity and compatibility with the current telecom systems. The security proof for four coherent states phase-shift keying (4-PSK) protocol has recently been established by applying numerical methods. However, the achievable key rate is relatively low compared with the optimal Gaussian modulation scheme. To enhance the key rate of discrete-modulation protocol, we first show that 8-PSK increases the key rate by about 60\% in comparison to 4-PSK, whereas the key rate has no significant improvement from 8-PSK to 12-PSK. We then expand the 12-PSK to two-ring constellation structure with four states in the inner ring and eight states in the outer ring, which significantly improves the key rate to be 2.4 times of that of 4-PSK. The key rate of the two-ring constellation structure can reach 70\% of the key rate achieved by Gaussian modulation in long distance transmissions, making this protocol an attractive alternative for high-rate and low-cost application in secure quantum communication networks.


title: Impact angle control of local intense d$B$/d$t$ variations during shock-induced substorms

abstract: The impact of interplanetary shocks on the magnetosphere can trigger magnetic substorms that intensify auroral electrojet currents. These currents enhance ground magnetic field perturbations (d$B$/d$t$), which in turn generate geomagnetically induced currents (GICs) that can be detrimental to power transmission infrastructure. We perform a comparative study of d$B$/d$t$ variations in response to two similarly strong shocks, but with one being nearly frontal, and the other, highly inclined. Multi-instrument analyses by the Time History of Events and Macroscale Interactions during Substorms (THEMIS) and Los Alamos National Laboratory spacecraft show that nightside substorm-time energetic particle injections are more intense and occur faster in the case of the nearly head-on impact. The same trend is observed in d$B$/d$t$ variations recorded by THEMIS ground magnetometers. THEMIS all-sky imager data show a fast and clear poleward auroral expansion in the first case, which does not clearly occur in the second case. Strong field-aligned currents computed with the spherical elementary current system (SECS) technique occur in both cases, but the current variations resulting from the inclined shock impact are weaker and slower compared to the nearly frontal case. SECS analyses also reveal that geographic areas with d$B$/d$t$ surpassing the thresholds 1.5 and 5 nT/s, usually linked to high-risk GICs, are larger and occur earlier due to the symmetric compression caused by the nearly head-on impact. These results, with profound space weather implications, suggest that shock impact angles affect the geospace driving conditions and the location and intensity of the subsequent d$B$/d$t$ variations during substorm activity.


title: PoseKernelLifter: Metric Lifting of 3D Human Pose using Sound

abstract: Reconstructing the 3D pose of a person in metric scale from a single view image is a geometrically ill-posed problem. For example, we can not measure the exact distance of a person to the camera from a single view image without additional scene assumptions (e.g., known height). Existing learning based approaches circumvent this issue by reconstructing the 3D pose up to scale. However, there are many applications such as virtual telepresence, robotics, and augmented reality that require metric scale reconstruction. In this paper, we show that audio signals recorded along with an image, provide complementary information to reconstruct the metric 3D pose of the person. The key insight is that as the audio signals traverse across the 3D space, their interactions with the body provide metric information about the body's pose. Based on this insight, we introduce a time-invariant transfer function called pose kernel -- the impulse response of audio signals induced by the body pose. The main properties of the pose kernel are that (1) its envelope highly correlates with 3D pose, (2) the time response corresponds to arrival time, indicating the metric distance to the microphone, and (3) it is invariant to changes in the scene geometry configurations. Therefore, it is readily generalizable to unseen scenes. We design a multi-stage 3D CNN that fuses audio and visual signals and learns to reconstruct 3D pose in a metric scale. We show that our multi-modal method produces accurate metric reconstruction in real world scenes, which is not possible with state-of-the-art lifting approaches including parametric mesh regression and depth regression.


title: Anisotropic Caffarelli-Kohn-Nirenberg type inequalities

abstract: Caffarelli, Kohn and Nirenberg considered in 1984 the interpolation inequalities \[\||x|^{\gamma_1}u\|_{L^s(\mathbb{R}^n)}\le C\||x|^{\gamma_2}\nabla u\|_{L^p(\mathbb{R}^n)}^a\||x|^{\gamma_3}u\|_{L^q(\mathbb{R}^n)}^{1-a} \] in dimension $n\ge 1$, and established necessary and sufficient conditions for which to hold under natural assumptions on the parameters. Motivated by our study of the asymptotic stability of solutions to the Navier-Stokes equations, we consider a more general and improved anisotropic version of the interpolation inequalities \[ \||x|^{\gamma_1}|x'|^{\alpha}u\|_{L^s(\mathbb{R}^n)}\le C\||x|^{\gamma_2}|x'|^{\mu}\nabla u\|_{L^p(\mathbb{R}^n)}^{a}\||x|^{\gamma_3}|x'|^{\beta}u\|_{L^q(\mathbb{R}^n)}^{1-a} \] in dimensions $n\ge 2$, where $x=(x', x_n)$ and $x'=(x_1, ..., x_{n-1})$, and give necessary and sufficient conditions for which to hold under natural assumptions on the parameters. Moreover we extend the Caffarelli-Kohn-Nirenberg inequalities from $q\ge 1$ to $q>0$. This extension, together with a nonlinear Poincar\'{e} inequality which we obtain in this paper, has played an important role in our proof of the above mentioned anisotropic interpolation inequalities.


title: The Ricci Flow and the Early Universe

abstract: A framework of quantum spacetime reference frame is proposed and reviewed, in which the quantum spacetime at the Gaussian approximation is deformed by the Ricci flow. At sufficient large scale, the Ricci flow not only smooths out local small irregularities making the universe a homogeneous and isotropic Friedmann-Robertson-Walker metric, but also develops a local singularity at the physical-time origin. Due to the phenomenological suppression of the non-Gaussian primordial perturbations, we assume the validity of the Ricci flow applying to the high curvature region near the local singularity of the early universe. The no-local-collapsing theorem of Perelman ensures the existence of a canonical neighborhood around the large curvature pinching point, which resembles a gradient shrinking Ricci soliton (GSRS) solution of the Ricci flow. Without any inflaton field, the GSRS naturally reproduces an exact inflationary deSitter universe near the singularity at the leading order. Without any rolling-down behavior of inflaton, the deviation from exact deSitter described by the "slow roll parameters" can be calculated by a small deviation from the singular flow-time via the Ricci flow, and the primordial perturbations can also be studied on the GSRS background, the power spectrum of the scalar perturbation agrees with present observations, and the one of the tensor perturbation is predicted too small to be detectable than the standard inflation. The previous treatment of the cosmological constant and the effective gravity are also briefly reviewed in the framework. So we argue that the Ricci flow provides us a possible unified view and treatment of the late epoch accelerating expansion and early epoch inflation of the universe without introducing dark energy or inflaton (dark energy of the second kind).


title: Scalable Primitives for Generalized Sensor Fusion in Autonomous Vehicles

abstract: In autonomous driving, there has been an explosion in the use of deep neural networks for perception, prediction and planning tasks. As autonomous vehicles (AVs) move closer to production, multi-modal sensor inputs and heterogeneous vehicle fleets with different sets of sensor platforms are becoming increasingly common in the industry. However, neural network architectures typically target specific sensor platforms and are not robust to changes in input, making the problem of scaling and model deployment particularly difficult. Furthermore, most players still treat the problem of optimizing software and hardware as entirely independent problems. We propose a new end to end architecture, Generalized Sensor Fusion (GSF), which is designed in such a way that both sensor inputs and target tasks are modular and modifiable. This enables AV system designers to easily experiment with different sensor configurations and methods and opens up the ability to deploy on heterogeneous fleets using the same models that are shared across a large engineering organization. Using this system, we report experimental results where we demonstrate near-parity of an expensive high-density (HD) LiDAR sensor with a cheap low-density (LD) LiDAR plus camera setup in the 3D object detection task. This paves the way for the industry to jointly design hardware and software architectures as well as large fleets with heterogeneous configurations.


title: A generic physics-informed neural network-based framework for reliability assessment of multi-state systems

abstract: In this paper, we leverage the recent advances in physics-informed neural network (PINN) and develop a generic PINN-based framework to assess the reliability of multi-state systems (MSSs). The proposed methodology consists of two major steps. In the first step, we recast the reliability assessment of MSS as a machine learning problem using the framework of PINN. A feedforward neural network with two individual loss groups are constructed to encode the initial condition and state transitions governed by ordinary differential equations (ODEs) in MSS. Next, we tackle the problem of high imbalance in the magnitude of the back-propagated gradients in PINN from a multi-task learning perspective. Particularly, we treat each element in the loss function as an individual task, and adopt a gradient surgery approach named projecting conflicting gradients (PCGrad), where a task's gradient is projected onto the norm plane of any other task that has a conflicting gradient. The gradient projection operation significantly mitigates the detrimental effects caused by the gradient interference when training PINN, thus accelerating the convergence speed of PINN to high-precision solutions to MSS reliability assessment. With the proposed PINN-based framework, we investigate its applications for MSS reliability assessment in several different contexts in terms of time-independent or dependent state transitions and system scales varying from small to medium. The results demonstrate that the proposed PINN-based framework shows generic and remarkable performance in MSS reliability assessment, and the incorporation of PCGrad in PINN leads to substantial improvement in solution quality and convergence speed.


title: Evolutionary paths to lateralization of complex brain functions

abstract: At large, most animal brains present two mirror-symmetric sides; but closer inspection reveals a range of asymmetries (in shape and function), that seem more salient in more cognitively complex species. Sustaining symmetric, redundant neural circuitry has associated metabolic costs, but it might aid in implementing computations within noisy environments or with faulty pieces. It has been suggested that the complexity of a computational task might play a role in breaking bilaterally symmetric circuits into fully lateralized ones; yet a rigorous, mathematically grounded theory of how this mechanism might work is missing. Here we provide such a mathematical framework, starting with the simplest assumptions, but extending our results to a comprehensive range of biologically and computationally relevant scenarios. We show mathematically that only fully lateralized or bilateral solutions are relevant within our framework (dismissing configurations in which circuits are only partially engaged). We provide maps that show when each of these configurations is preferred depending on costs, contributed fitness, circuit reliability, and task complexity. We discuss evolutionary paths leading from bilateral to lateralized configurations and other possible outcomes. The implications of these results for evolution, development, and rehabilitation of damaged or aged brains is discussed. Our work constitutes a limit case that should constrain and underlie similar mappings when other aspects (aside task complexity and circuit reliability) are considered.


title: Convergence of GANs Training: A Game and Stochastic Control Methodology

abstract: Training generative adversarial networks (GANs) is known to be difficult, especially for financial time series. This paper first analyzes the well-posedness problem in GANs minimax games and the convexity issue in GANs objective functions. It then proposes a stochastic control framework for hyper-parameters tuning in GANs training. The weak form of dynamic programming principle and the uniqueness and the existence of the value function in the viscosity sense for the corresponding minimax game are established. In particular, explicit forms for the optimal adaptive learning rate and batch size are derived and are shown to depend on the convexity of the objective function, revealing a relation between improper choices of learning rate and explosion in GANs training. Finally, empirical studies demonstrate that training algorithms incorporating this adaptive control approach outperform the standard ADAM method in terms of convergence and robustness. From GANs training perspective, the analysis in this paper provides analytical support for the popular practice of ``clipping'', and suggests that the convexity and well-posedness issues in GANs may be tackled through appropriate choices of hyper-parameters.


title: Impact of $Z \to \eta_{c,b}+g+g$ on the inclusive $\eta_{c,b}$ meson yield in $Z$-boson decay

abstract: In this paper, we carry out the next-to-leading-order QCD corrections to $Z \to \eta_Q+g+g~(Q=c,b)$ (labeled as $gg$) through the color-singlet (CS) state of $Q\bar{Q}[^1S_0^{[1]}]$, with the aim of assessing the impact of this process on $Z$ bosons decaying into inclusive $\eta_Q$. We find that the QCD corrections to the $gg$ process can notably enhance its leading-order results, especially for the $\eta_c$ case, which would then greatly increase the existing predictions of $\Gamma_{Z \to \eta_Q+X}$ given by the CS-dominant process $Z \to \eta_{Q}[^1S_0^{[1]}]+Q+\bar{Q}$. Moreover, with these significant QCD corrections, the $gg$ process would exert crucial influence on the CS-predicted $\eta_Q$ energy distributions. In conclusion, in the CS studies of $Z \to \eta_Q+X$, besides $Z \to \eta_{Q}[^1S_0^{[1]}]+Q+\bar{Q}$, $Z \to \eta_Q[^1S_0^{[1]}]+g+g$ can provide phenomenologically indispensable contributions as well.


title: Functional regression clustering with multiple functional gene expressions

abstract: Gene expression data is often collected in time series experiments, under different experimental conditions. There may be genes that have very different gene expression profiles over time, but that adjust their gene expression patterns in the same way under experimental conditions. Our aim is to develop a method that finds clusters of genes in which the relationship between these temporal gene expression profiles are similar to one another, even if the individual temporal gene expression profiles differ. We propose a $K$-means type algorithm in which each cluster is defined by a function-on-function regression model, which, inter alia, allows for multiple functional explanatory variables. We validate this novel approach through extensive simulations and then apply it to identify groups of genes whose diurnal expression pattern is perturbed by the season in a similar way. Our clusters are enriched for genes with similar biological functions, including one cluster enriched in both photosynthesis-related functions and polysomal ribosomes, which shows that our method provides useful and novel biological insights.


title: Layering and vertical transport in sheared double diffusive convection in the diffusive regime

abstract: A sequence of two and three-dimensional simulations is conducted for the double diffusive convection (DDC) flows in the diffusive regime subjected to an imposed shear. The flow is confined between two horizontal plates which are maintained at different constant temperature, salinity, and different velocity, thus setting up a shear across the flow. The lower plate is fixed at higher temperature and salinity, while the overall (unperturbed) density gradient is statically stable. For a wide range of control parameters, and for sufficiently strong perturbation of the conductive initial state, we find that staircase-like structures spontaneously develop, with relatively well-mixed layers separated by sharp interfaces of enhanced scalar gradient. Such staircases appear to be robust even in the presence of strong shear over very long times, although we typically observe early time coarsening of the number of observed layers. For the same set of control parameters, different asymptotic layered states, with markedly different vertical scalar fluxes, can arise for different initial perturbation structures. The imposed shear does significantly spatio-temporally modify the vertical transport of the various scalars. The flux ratio (i.e., the ratio between the density fluxes due to the total (convective and diffusive) salt flux and the total heat flux) is found, at steady state, to be essentially equal to the square root of the ratio of the salt diffusivity to the thermal diffusivity, consistently with the physical model originally proposed by Linden and Shirtcliffe (1978) and the variational arguments presented by Stern (1982) for unsheared double diffusive convection.


title: Conjectured $DXZ$ decompositions of a unitary matrix

abstract: For any unitary matrix there exists a ZXZ decomposition, according to a theorem by Idel and Wolf. For any even-dimensional unitary matrix there exists a block-ZXZ decomposition, according to a theorem by F\"uhr and Rzeszotnik. We conjecture that these two decompositions are merely special cases of a set of decompositions, one for every divisor of the matrix dimension. For lack of a proof, we provide an iterative Sinkhorn algorithm to find an approximate numerical decomposition.


title: A Machine Learning Analysis of COVID-19 Mental Health Data

abstract: In late December 2019, the novel coronavirus (Sars-Cov-2) and the resulting disease COVID-19 were first identified in Wuhan China. The disease slipped through containment measures, with the first known case in the United States being identified on January 20th, 2020. In this paper, we utilize survey data from the Inter-university Consortium for Political and Social Research and apply several statistical and machine learning models and techniques such as Decision Trees, Multinomial Logistic Regression, Naive Bayes, k-Nearest Neighbors, Support Vector Machines, Neural Networks, Random Forests, Gradient Tree Boosting, XGBoost, CatBoost, LightGBM, Synthetic Minority Oversampling, and Chi-Squared Test to analyze the impacts the COVID-19 pandemic has had on the mental health of frontline workers in the United States. Through the interpretation of the many models applied to the mental health survey data, we have concluded that the most important factor in predicting the mental health decline of a frontline worker is the healthcare role the individual is in (Nurse, Emergency Room Staff, Surgeon, etc.), followed by the amount of sleep the individual has had in the last week, the amount of COVID-19 related news an individual has consumed on average in a day, the age of the worker, and the usage of alcohol and cannabis.


title: Efficient loading of reduced data ensembles produced at ORNL SNS/HFIR neutron time-of-flight facilities

abstract: We present algorithmic improvements to the loading operations of certain reduced data ensembles produced from neutron scattering experiments at Oak Ridge National Laboratory (ORNL) facilities. Ensembles from multiple measurements are required to cover a wide range of the phase space of a sample material of interest. They are stored using the standard NeXus schema on individual HDF5 files. This makes it a scalability challenge, as the number of experiments stored increases in a single ensemble file. The present work follows up on our previous efforts on data management algorithms, to address identified input output (I/O) bottlenecks in Mantid, an open-source data analysis framework used across several neutron science facilities around the world. We reuse an in-memory binary-tree metadata index that resembles data access patterns, to provide a scalable search and extraction mechanism. In addition, several memory operations are refactored and optimized for the current common use cases, ranging most frequently from 10 to 180, and up to 360 separate measurement configurations. Results from this work show consistent speed ups in wall-clock time on the Mantid LoadMD routine, ranging from 19\% to 23\% on average, on ORNL production computing systems. The latter depends on the complexity of the targeted instrument-specific data and the system I/O and compute variability for the shared computational resources available to users of ORNL's Spallation Neutron Source (SNS) and the High Flux Isotope Reactor (HFIR) instruments. Nevertheless, we continue to highlight the need for more research to address reduction challenges as experimental data volumes, user time and processing costs increase.


title: Frequency Fitness Assignment: Optimization without Bias for Good Solutions can be Efficient

abstract: A fitness assignment process transforms the features (such as the objective value) of a candidate solution to a scalar fitness, which then is the basis for selection. Under Frequency Fitness Assignment (FFA), the fitness corresponding to an objective value is its encounter frequency in selection steps and is subject to minimization. FFA creates algorithms that are not biased towards better solutions and are invariant under all injective transformations of the objective function value. We investigate the impact of FFA on the performance of two theory-inspired, state-of-the-art EAs, the Greedy (2+1) GA and the Self-Adjusting (1+(lambda,lambda)) GA. FFA improves their performance significantly on some problems that are hard for them. In our experiments, one FFA-based algorithm exhibited mean runtimes that appear to be polynomial on the theory-based benchmark problems in our study, including traps, jumps, and plateaus. We propose two hybrid approaches that use both direct and FFA-based optimization and find that they perform well. All FFA-based algorithms also perform better on satisfiability problems than any of the pure algorithm variants.


title: Brauer-Manin obstructions on hyperelliptic curves

abstract: We describe a practical algorithm for computing Brauer-Manin obstructions to the existence of rational points on hyperelliptic curves defined over number fields. This offers advantages over descent based methods in that its correctness does not rely on rigorous class and unit group computations of large degree number fields. We report on experiments showing it to be a very effective tool for deciding existence of rational points: Among a random samples of curves over the rational numbers of genus at least $5$ we were able to decide existence of rational points for over $99\%$ of curves. We also demonstrate its effectiveness for high genus curves, giving an example of a genus $50$ hyperelliptic curve with a Brauer-Manin obstrution to the Hasse Principle. The main theoretical development allowing for this algorithm is an extension of the descent theory for abelian torsors to a framework of torsors with restricted ramification.


title: WALLABY Pilot Survey: HI gas disc truncation and star formation of galaxies falling into the Hydra I cluster

abstract: We present results from our analysis of the Hydra I cluster observed in neutral atomic hydrogen (HI) as part of the Widefield ASKAP L-band Legacy All-sky Blind Survey (WALLABY). These WALLABY observations cover a 60-square-degree field of view with uniform sensitivity and a spatial resolution of 30 arcsec. We use these wide-field observations to investigate the effect of galaxy environment on HI gas removal and star formation quenching by comparing the properties of cluster, infall and field galaxies extending up to $\sim5R_{200}$ from the cluster centre. We find a sharp decrease in the HI-detected fraction of infalling galaxies at a projected distance of $\sim1.5R_{200}$ from the cluster centre from $\sim0.85\%$ to $\sim0.35\%$. We see evidence for the environment removing gas from the outskirts of HI-detected cluster and infall galaxies through the decrease in the HI to $r$-band optical disc diameter ratio. These galaxies lie on the star forming main sequence, indicating that gas removal is not yet affecting the inner star-forming discs and is limited to the galaxy outskirts. Although we do not detect galaxies undergoing galaxy-wide quenching, we do observe a reduction in recent star formation in the outer disc of cluster galaxies, which is likely due to the smaller gas reservoirs present beyond the optical radius in these galaxies. Stacking of HI non-detections with HI masses below $M_{\rm{HI}}\lesssim10^{8.4}\,\rm{M}_{\odot}$ will be required to probe the HI of galaxies undergoing quenching at distances $\gtrsim60$ Mpc with WALLABY.


title: Interplay between reflection positivity and crossing symmetry in the bootstrap approach to CFT

abstract: Crossing symmetry (CS) is the main tool in the bootstrap program applied to CFT models. This consists in an equality which imposes restrictions on the CFT data of a model, i.e, the OPE coefficients and the conformal dimensions. Reflection positivity (RP) has also played a role, since this condition lead to the unitary bound and reality of the OPE coefficients. In this paper we show that RP can still reveal more information, showing how RP itself can capture an important part of the restrictions imposed by the full CS equality. In order to do that, we use a connection used by us in a previous work between RP and positive definiteness of a function of a single variable. This allows to write constraints on the OPE coefficients in a concise way, encoding in the conditions that certain functions of the crossratio will be positive defined and in particular completely monotonic. We will consider how the bounding of scalar conformal dimensions and OPE coefficients arise in this RP based approach. We will illustrate the conceptual and practical value of this view trough examples of general CFT models in $d$-dimensions.


title: Pressure dependent magnetic properties on bulk CrBr3 single crystals

abstract: The van der Waals class of materials offer an approach to two-dimensional magnetism as their spin fluctuations can be tuned upon exfoliation of layers. Moreover, it has recently been shown that spin-lattice coupling and long-range magnetic ordering can be modified with pressure in van der Waals materials. In this work, the magnetic properties of quasi two-dimensional CrBr3 are reported applying hydrostatic pressure. The application of pressure (0 - 0.8 GPa) shows a 72 % decrease in saturation magnetization with small decrease in the Curie temperature from 33 to 29 K. Density functional theory calculations with pressure up to 1 GPa show a reduction in volume and interplanar distance as pressure increases. To further understand magnetic properties with applied pressure, the magnetocrystalline anisotropy energy (MAE) and exchange coupling parameter (J) are calculated. There is minimal decrease in MAE and the first nearest neighbor interaction (J1) (U = 2.7 eV and J = 0.7 eV), shows an increase in J1 with respect to pressure. Overall, CrBr3 displays ferromagnetic interlayer coupling and the calculated exchange coupling and MAE parameters match well with the observations from the experimental work.


title: MC-Blur: A Comprehensive Benchmark for Image Deblurring

abstract: Blur artifacts can seriously degrade the visual quality of images, and numerous deblurring methods have been proposed for specific scenarios. However, in most real-world images, blur is caused by different factors, e.g., motion and defocus. In this paper, we address how different deblurring methods perform in the case of multiple types of blur. For in-depth performance evaluation, we construct a new large-scale multi-cause image deblurring dataset (called MC-Blur), including real-world and synthesized blurry images with mixed factors of blurs. The images in the proposed MC-Blur dataset are collected using different techniques: averaging sharp images captured by a 1000-fps high-speed camera, convolving Ultra-High-Definition (UHD) sharp images with large-size kernels, adding defocus to images, and real-world blurry images captured by various camera models. Based on the MC-Blur dataset, we conduct extensive benchmarking studies to compare SOTA methods in different scenarios, analyze their efficiency, and investigate the built dataset's capacity. These benchmarking results provide a comprehensive overview of the advantages and limitations of current deblurring methods, and reveal the advances of our dataset.


title: Open-bore vertical MRI scanners generate significantly less RF heating around deep brain stimulation leads compared to horizontal scanners

abstract: Objectives Studies that assess magnetic resonance imaging (MRI) induced radiofrequency (RF) heating of the tissue in the presence of an active electronic implant are mostly performed in horizontal, closed-bore scanners. Vertical, open-bore MRI systems have a 90{\deg} rotated magnet and generate a fundamentally different RF field distribution in the body, yet little is known about the RF heating of deep brain stimulation (DBS) systems in this class of scanners. Here, we investigated whether RF heating of DBS devices was significantly different in a vertical, open-bore MRI scanner compared to a horizontal, closed-bore MRI scanner. Materials and Methods In this phantom study, RF heating around the lead of a commercial DBS system implanted in an anthropomorphic phantom was evaluated in a 1.2 T vertical open-bore scanner (Oasis, Fujifilm Healthcare) and a 1.5 T horizontal closed-bore scanner (Aera, Siemens Healthineers). DBS devices were implanted following 30 realistic lead trajectories. Electromagnetic simulations were performed to assess the specific absorption rate (SAR) of RF energy around leads with different internal structures. Results When controlling for B1+rms, temperature increase around the lead-tip was significantly lower at the vertical scanner compared to the horizontal scanner (p-value=9.1x10-7). Electromagnetic simulations demonstrated up to a 14-fold reduction in the maximum 0.1g-averaged SAR deposited in the tissue surrounding the lead-tip in a vertical scanner compared to a horizontal scanner for leads with straight and helical internal wires. Conclusions RF experiments and electromagnetic simulations demonstrated consistently lower RF heating and power deposition around the DBS lead-tip at the vertical scanner compared to the horizontal scanner. Our simulation results suggest that this trend in heating may potentially extend to leads from other manufacturers.


title: VoRTX: Volumetric 3D Reconstruction With Transformers for Voxelwise View Selection and Fusion

abstract: Recent volumetric 3D reconstruction methods can produce very accurate results, with plausible geometry even for unobserved surfaces. However, they face an undesirable trade-off when it comes to multi-view fusion. They can fuse all available view information by global averaging, thus losing fine detail, or they can heuristically cluster views for local fusion, thus restricting their ability to consider all views jointly. Our key insight is that greater detail can be retained without restricting view diversity by learning a view-fusion function conditioned on camera pose and image content. We propose to learn this multi-view fusion using a transformer. To this end, we introduce VoRTX, an end-to-end volumetric 3D reconstruction network using transformers for wide-baseline, multi-view feature fusion. Our model is occlusion-aware, leveraging the transformer architecture to predict an initial, projective scene geometry estimate. This estimate is used to avoid backprojecting image features through surfaces into occluded regions. We train our model on ScanNet and show that it produces better reconstructions than state-of-the-art methods. We also demonstrate generalization without any fine-tuning, outperforming the same state-of-the-art methods on two other datasets, TUM-RGBD and ICL-NUIM.


title: DECi-hertz Interferometer Gravitational-wave Observatory: Forecast constraints on the cosmic curvature with LSST strong lenses

abstract: In this paper, we aim at using the DECi-hertz Interferometer Gravitational-wave Observatory (DECIGO), a future Japanese space gravitational-wave antenna sensitive to frequency range between LISA and ground-based detectors, to provide gravitational-wave constraints on the cosmic curvature at $z\sim 5$. In the framework of the well-known distance sum rule, the perfect redshift coverage of the standard sirens observed by DECIGO, compared with lensing observations including the source and lens from LSST, makes such cosmological-model-independent test more natural and general. Focusing on three kinds of spherically symmetric mass distributions for the lensing galaxies, we find that the cosmic curvature is expected to be constrained with the precision of $\Delta \Omega_K \sim 10^{-2}$ in the early universe ($z\sim5.0$), improving the sensitivity of ET constraints by about a factor of 10. However, in order to investigate this further, the mass density profiles of early-type galaxies should be properly taken into account. Specially, our analysis demonstrates the strong degeneracy between the spatial curvature and the lens parameters, especially the redshift evolution of power-law lens index parameter. When the extended power law mass density profile is assumed, the weakest constraint on the cosmic curvature can be obtained. Whereas, the addition of DECIGO to the combination of LSST+DECIGO does improve the constraint on the luminosity density slope and the anisotropy of the stellar velocity dispersion significantly. Therefore, our paper highlights the benefits of synergies between DECIGO and LSST in constraining new physics beyond the standard model, which could manifest itself through accurate determination of the cosmic curvature.


title: Imbalanced Graph Classification via Graph-of-Graph Neural Networks

abstract: Graph Neural Networks (GNNs) have achieved unprecedented success in identifying categorical labels of graphs. However, most existing graph classification problems with GNNs follow the protocol of balanced data splitting, which misaligns with many real-world scenarios in which some classes have much fewer labels than others. Directly training GNNs under this imbalanced scenario may lead to uninformative representations of graphs in minority classes, and compromise the overall classification performance, which signifies the importance of developing effective GNNs towards handling imbalanced graph classification. Existing methods are either tailored for non-graph structured data or designed specifically for imbalanced node classification while few focus on imbalanced graph classification. To this end, we introduce a novel framework, Graph-of-Graph Neural Networks (G$^2$GNN), which alleviates the graph imbalance issue by deriving extra supervision globally from neighboring graphs and locally from stochastic augmentations of graphs. Globally, we construct a graph of graphs (GoG) based on kernel similarity and perform GoG propagation to aggregate neighboring graph representations. Locally, we employ topological augmentation via masking node features or dropping edges with self-consistency regularization to generate stochastic augmentations of each graph that improve the model generalibility. Extensive graph classification experiments conducted on seven benchmark datasets demonstrate our proposed G$^2$GNN outperforms numerous baselines by roughly 5\% in both F1-macro and F1-micro scores. The implementation of G$^2$GNN is available at https://github.com/YuWVandy/G2GNN}{https://github.com/YuWVandy/G2GNN


title: Interpretable Machine Learning for Materials Design

abstract: Fueled by the widespread adoption of Machine Learning (ML) and the high-throughput screening of materials, the data-centric approach to materials design has asserted itself as a robust and powerful tool for the in-silico prediction of materials properties. When training models to predict material properties, researchers often face a difficult choice between a model's interpretability or its performance. We study this trade-off by leveraging four different state-of-the-art ML techniques: XGBoost, SISSO, Roost, and TPOT for the prediction of structural and electronic properties of perovskites and 2D materials. We then assess the future outlook of the continued integration of ML into materials discovery and identify key problems that will continue to challenge researchers as the size of the literature's datasets and complexity of models increases. Finally, we offer several possible solutions to these challenges with a focus on retaining interpretability and share our thoughts on magnifying the impact of ML on materials design.


title: Measurements of Proton High Order Cumulants in 3 GeV Au+Au Collisions and Implications for the QCD Critical Point

abstract: We report cumulants of the proton multiplicity distribution from dedicated fixed-target Au+Au collisions at 3.0 GeV, measured by the STAR experiment in the kinematic acceptance of rapidity ($y$) and transverse momentum ($p_{\rm T}$) within $-0.5 < y<0$ and $0.4 < p_{\rm T} <2.0 $ GeV/$c$. In the most central 0--5\% collisions, a proton cumulant ratio is measured to be $C_4/C_2=-0.85 \pm 0.09 ~(\rm stat.) \pm 0.82 ~(\rm syst.)$, which is less than unity, the Poisson baseline. The hadronic transport UrQMD model reproduces our $C_4/C_2$ in the measured acceptance. Compared to higher energy results and the transport model calculations, the suppression in $C_4/C_2$ is consistent with fluctuations driven by baryon number conservation and indicates an energy regime dominated by hadronic interactions. These data imply that the QCD critical region, if created in heavy-ion collisions, could only exist at energies higher than 3\,GeV.


title: Challenges for the statistical gravitational-wave method to measure the Hubble constant

abstract: Gravitational waves (GW) can be employed as standard sirens that will soon measure the Hubble constant with sufficient precision to weigh in on the $\sim 5\sigma$ Hubble tension. Most GW sources will have no identified electromagnetic counterpart, leading to uncertainty in the redshift of the source, and in turn a degeneracy between host galaxy distance, redshift, and $H_0$. In the case where no electromagnetic counterparts are identified, it has been proposed that a statistical canvassing of candidate GW hosts, found in a large galaxy survey for example, can be used to accurately constrain the Hubble constant. We study and simulate this "galaxy voting" method to compute $H_0$. We find that the Hubble constant posterior is in general biased relative to the true value even when making optimistic assumptions about the statistical properties of the sample. Using the MICECAT light-cone catalog, we find that the bias in the $H_0$ posteriors depends on the realization of the underlying galaxy sample and the precision of the GW source distance measurement.


title: High-Resolution WiFi Imaging with Reconfigurable Intelligent Surfaces

abstract: WiFi-based imaging enables pervasive sensing in a privacy-preserving and cost-effective way. However, most of existing methods either require specialized hardware modification or suffer from poor imaging performance due to the fundamental limit of off-the-shelf commodity WiFi devices in spatial resolution. We observe that the recently developed reconfigurable intelligent surface (RIS) could be a promising solution to overcome these challenges. Thus, in this paper, we propose a RIS-aided WiFi imaging framework to achieve high-resolution imaging with the off-the-shelf WiFi devices. Specifically, we first design a beamforming method to achieve the first-stage imaging by separating the signals from different spatial locations with the aid of the RIS. Then, we propose an optimization-based super-resolution imaging algorithm by leveraging the low rank nature of the reconstructed object. During the optimization, we also explicitly take into account the effect of finite phase quantization in RIS to avoid the resolution degradation due to quantization errors. Simulation results demonstrate that our framework achieves median root mean square error (RMSE) of 0.03 and median structural similarity (SSIM) of 0.52. The visual results show that high-resolution imaging results are achieved with simulation signals at 5 GHz that are matched with commercial WiFi 802.11n/ac protocols.


title: Electric Field Induced Macroscopic Cellular Phase of Nanoparticles

abstract: A suspension of nanoparticles with very low volume fraction is found to assemble into a macroscopic cellular phase under the collective influence of AC and DC voltages. Systematic study of this phase transition shows that it was the result of electrophoretic assembly into a two-dimensional configuration followed by spinodal decomposition into particle-rich walls and particle-poor cells mediated principally by electrohydrodynamic flow. This mechanistic understanding reveals two characteristics needed for a cellular phase to form, namely 1) a system that is considered two dimensional and 2) short-range attractive, long-range repulsive interparticle interactions. In addition to determining the mechanism underpinning the formation of the cellular phase, this work presents a method to reversibly assemble microscale continuous structures out of nanoscale particles in a manner that may enable the creation of materials that impact diverse fields including energy storage and filtration.


title: Global mild solutions to the Vlasov-Maxwell-Fokker-Planck system

abstract: Motivated by Duan et al.[Global Mild Solutions of the Landau and Non-Cutoff Boltzmann Equations, Comm. Pure Appl. Math., 74(5), 932-1020.], the global existence of mild solutions to the Vlasov-Maxwell-Fokker-Planck system near a global Maxwellians with small-amplitude initial data in the function space $L^1_kL^\infty_TL^2_v$ is constructed. Moreover, the exponential time decay of the solutions is obtained.


title: True or False: Does the Deep Learning Model Learn to Detect Rumors?

abstract: It is difficult for humans to distinguish the true and false of rumors, but current deep learning models can surpass humans and achieve excellent accuracy on many rumor datasets. In this paper, we investigate whether deep learning models that seem to perform well actually learn to detect rumors. We evaluate models on their generalization ability to out-of-domain examples by fine-tuning BERT-based models on five real-world datasets and evaluating against all test sets. The experimental results indicate that the generalization ability of the models on other unseen datasets are unsatisfactory, even common-sense rumors cannot be detected. Moreover, we found through experiments that models take shortcuts and learn absurd knowledge when the rumor datasets have serious data pitfalls. This means that simple modifications to the rumor text based on specific rules will lead to inconsistent model predictions. To more realistically evaluate rumor detection models, we proposed a new evaluation method called paired test (PairT), which requires models to correctly predict a pair of test samples at the same time. Furthermore, we make recommendations on how to better create rumor dataset and evaluate rumor detection model at the end of this paper.


title: AdaAfford: Learning to Adapt Manipulation Affordance for 3D Articulated Objects via Few-shot Interactions

abstract: Perceiving and interacting with 3D articulated objects, such as cabinets, doors, and faucets, pose particular challenges for future home-assistant robots performing daily tasks in human environments. Besides parsing the articulated parts and joint parameters, researchers recently advocate learning manipulation affordance over the input shape geometry which is more task-aware and geometrically fine-grained. However, taking only passive observations as inputs, these methods ignore many hidden but important kinematic constraints (e.g., joint location and limits) and dynamic factors (e.g., joint friction and restitution), therefore losing significant accuracy for test cases with such uncertainties. In this paper, we propose a novel framework, named AdaAfford, that learns to perform very few test-time interactions for quickly adapting the affordance priors to more accurate instance-specific posteriors. We conduct large-scale experiments using the PartNet-Mobility dataset and prove that our system performs better than baselines.


title: Adversarial Attacks Against Deep Generative Models on Data: A Survey

abstract: Deep generative models have gained much attention given their ability to generate data for applications as varied as healthcare to financial technology to surveillance, and many more - the most popular models being generative adversarial networks and variational auto-encoders. Yet, as with all machine learning models, ever is the concern over security breaches and privacy leaks and deep generative models are no exception. These models have advanced so rapidly in recent years that work on their security is still in its infancy. In an attempt to audit the current and future threats against these models, and to provide a roadmap for defense preparations in the short term, we prepared this comprehensive and specialized survey on the security and privacy preservation of GANs and VAEs. Our focus is on the inner connection between attacks and model architectures and, more specifically, on five components of deep generative models: the training data, the latent code, the generators/decoders of GANs/ VAEs, the discriminators/encoders of GANs/ VAEs, and the generated data. For each model, component and attack, we review the current research progress and identify the key challenges. The paper concludes with a discussion of possible future attacks and research directions in the field.


title: Simulation platform for pattern recognition based on reservoir computing with memristor networks

abstract: Memristive systems and devices are potentially available for implementing reservoir computing (RC) systems applied to pattern recognition. However, the computational ability of memristive RC systems depends on intertwined factors such as system architectures and physical properties of memristive elements, which complicates identifying the key factor for system performance. Here we develop a simulation platform for RC with memristor device networks, which enables testing different system designs for performance improvement. Numerical simulations show that the memristor-network-based RC systems can yield high computational performance comparable to that of state-of-the-art methods in three time series classification tasks. We demonstrate that the excellent and robust computation under device-to-device variability can be achieved by appropriately setting network structures, nonlinearity of memristors, and pre/post-processing, which increases the potential for reliable computation with unreliable component devices. Our results contribute to an establishment of a design guide for memristive reservoirs toward a realization of energy-efficient machine learning hardware.


title: Role of the effective range in the weak-binding relation

abstract: We study the range correction in the weak-binding relation, which relates the internal structure of hadrons with the scattering length and the binding energy. Utilizing the effective field theories, we show that the effective range originates from the derivative coupling interaction as well as from the channel coupling to the bare state, and that the different contributions are not distinguishable. By examining the compositeness in the effective field theories, it is demonstrated that the effective range induces the finite range correction for the weak-binding relation in addition to the previously known contributions. We thus propose to include the range correction in the uncertainty terms of the weak-binding relation.


title: Shallow Network Based on Depthwise Over-Parameterized Convolution for Hyperspectral Image Classification

abstract: Recently, convolutional neural network (CNN) techniques have gained popularity as a tool for hyperspectral image classification (HSIC). To improve the feature extraction efficiency of HSIC under the condition of limited samples, the current methods generally use deep models with plenty of layers. However, deep network models are prone to overfitting and gradient vanishing problems when samples are limited. In addition, the spatial resolution decreases severely with deeper depth, which is very detrimental to spatial edge feature extraction. Therefore, this letter proposes a shallow model for HSIC, which is called depthwise over-parameterized convolutional neural network (DOCNN). To ensure the effective extraction of the shallow model, the depthwise over-parameterized convolution (DO-Conv) kernel is introduced to extract the discriminative features. The depthwise over-parameterized Convolution kernel is composed of a standard convolution kernel and a depthwise convolution kernel, which can extract the spatial feature of the different channels individually and fuse the spatial features of the whole channels simultaneously. Moreover, to further reduce the loss of spatial edge features due to the convolution operation, a dense residual connection (DRC) structure is proposed to apply to the feature extraction part of the whole network. Experimental results obtained from three benchmark data sets show that the proposed method outperforms other state-of-the-art methods in terms of classification accuracy and computational efficiency.


title: Phase transition and enhanced hardness of LaB4 under pressure

abstract: The crystalline structures of lanthanum tetraboride, LaB4, under pressure are investigated using a genetic algorithm method coupled with first-principles calculations. We find two low-enthalpy phases for LaB4 as the thermodynamic ground state up to 200 GPa: a phase previously observed in experiments (P4/mbm) and a novel orthorhombic phase (Pnma-I). The P4/mbm phase transforms to the Pnma-I phase at around 106 GPa, accompanied by breakage of the B-octahedron. The P4/mbm phase of LaB4 exhibits a high hardness (30.5 GPa) at ambient conditions, which is comparable to that of the hard material B4C. The hardness of the two low-enthalpy phases increases with pressure. The electronic band structures shows that all of the competitive phases (two stable and two metastable phases) are metallic. Phonon calculations shows the P4/mbm and Pnma-I phases are thermodynamically stable in their respective pressure ranges. This elucidation of the phase transition behavior and hardness of LaB4 provides new knowledge on the interesting high-pressure behaviors of the rare-earth metal borides.


title: Laser guide star return-flux gain from frequency chirping

abstract: Spectral hole burning reduces sodium laser guide star efficiency. Due to photon recoil, atoms that are initially resonant with the single-frequency laser get Doppler shifted out of resonance, which reduces the return flux. Frequency-chirped (also known as frequency-swept) continuous-wave lasers have the potential to mitigate the effect of spectral hole burning and even increase the laser guide star efficiency beyond the theoretical limit of a single-frequency laser. On-sky measurements of a frequency-chirped, single-frequency laser guide star are performed at the Roque de los Muchachos Observatory on La Palma. In the experiment, a 35-cm telescope and a fast photon counting receiver system are employed to resolve the return flux response during laser frequency sweeps gaining insights into the population dynamics of the sodium layer. At a launched laser power of 16.5 W, we find a maximum gain in return flux of 22\% compared to a fixed-frequency laser. Our results suggest a strong dependence of chirping gain on power density at the mesosphere, i.e. laser power and seeing. Maximum gains are recorded at a chirping amplitude on the order of 150 MHz and a chirping rate of 0.8 MHz $\mu$s$^{-1}$, as predicted by theory. Time-resolved measurements during the chirping period confirm our understanding of the population dynamics in the sodium layer. To our knowledge these are the first measurements of return flux enhancement for laser guide stars excited by a single frequency-chirped continuous-wave laser. For higher laser powers, the effectiveness of chirping is expected to increase, which could be highly beneficial for telescopes equipped with high-power laser guide star adaptive optics systems, also for emerging space awareness applications using laser guide stars such as satellite imaging and ground-to-space optical communications.


title: Remarks on weak-strong uniqueness for two-fluid model

abstract: This paper concerns with the compressible two-fluid model with algebraic pressure closure. We prove a conditional weak-strong uniqueness principle, meaning that a finite energy weak solution, with bounded densities, coincides with the classical solution on the lifespan of the latter emanating from the same initial data.


title: A generalized primal-dual algorithm with improved convergence condition for saddle point problems

abstract: We generalize the well-known primal-dual algorithm proposed by Chambolle and Pock for saddle point problems, and improve the condition for ensuring its convergence. The improved convergence-guaranteeing condition is effective for the generic setting, and it is shown to be optimal. It also allows us to discern larger step sizes for the resulting subproblems, and thus provides a simple and universal way to improve numerical performance of the original primal-dual algorithm. In addition, we present a structure-exploring heuristic to further relax the convergence-guaranteeing condition for some specific saddle point problems, which could yield much larger step sizes and hence significantly better performance. Effectiveness of this heuristic is numerically illustrated by the classic assignment problem.


title: Approximate Bayesian Computation Applied to the Diffuse Gamma-ray Sky

abstract: Many sources contribute to the diffuse gamma-ray background (DGRB), including star forming galaxies, active galactic nuclei, and cosmic ray interactions in the Milky Way. Exotic sources, such as dark matter annihilation, may also make some contribution. The photon counts-in-pixels distribution is a powerful tool for analyzing the DGRB and determining the relative contributions of different sources. However, including photon energy information in a likelihood analysis of the counts-in-pixels distribution quickly becomes computationally intractable as the number of source types and energy bins increase. Here, we apply the likelihood-free method of Approximate Bayesian Computation (ABC) to the problem. We consider a mock analysis that includes contributions from dark matter annihilation in galactic subhalos as well as astrophysical backgrounds. We show that our results using ABC are consistent with the exact likelihood when energy information is discarded, and that significantly tighter parameter constraints can be obtained with ABC when energy information is included. ABC presents a powerful tool for analyzing the DGRB and understanding its varied origins.

categories: astro-ph.HE astro-ph.CO astro-ph.IM hep-ph


title: Using Reconfigurable Intelligent Surfaces for UE Positioning in mmWave MIMO Systems

abstract: A reconfigurable intelligent surface (RIS) consists of massive meta elements, which results in a reflection path between a base station (BS) and user equipment (UE). In wireless localization, this reflection path aids in positioning accuracy, especially when the line-of-sight (LOS) path is subject to severe blockage and fading. We develop a RIS-aided positioning framework to locate a UE in environments where the LOS path may or may not be available. We first estimate the RIS-aided channel parameters from the received signals at the UE. To reduce algorithmic complexity, we propose a linear combination of the estimated UE positions from the direct and reflection paths, which is shown to be approximately the maximum likelihood estimator under the large-sample regime when the estimates from different paths are independent. We optimize the RIS phase shifts to improve the positioning accuracy, and extend the proposed approach to the case with multiple BSs and UEs. We derive the Cramer-Rao bound (CRB) and demonstrate numerically that our proposed method approaches the CRB.


title: Harmonic numbers as the summation of integrals

abstract: Harmonic numbers arise from the truncation of the harmonic series. The $n^\text{th}$ harmonic number is the sum of the reciprocals of each positive integer up to $n$. In addition to briefly introducing the properties of harmonic numbers, we cover harmonic numbers as the summation of integrals that involve the product of exponential and hyperbolic secant functions. The proof is relatively simple since it only comprises the Principle of Mathematical Induction and integration by parts.


title: Conditional Randomization Rank Test

abstract: We propose a new method named the Conditional Randomization Rank Test (CRRT) for testing conditional independence of a response variable Y and a covariate variable X, conditional on the rest of the covariates Z. The new method generalizes the Conditional Randomization Test (CRT) of [CFJL18] by exploiting the knowledge of the conditional distribution of X|Z and is a conditional sampling based method that is easy to implement and interpret. In addition to guaranteeing exact type 1 error control, owing to a more flexible framework, the new method markedly outperforms the CRT in computational efficiency. We establish bounds on the probability of type 1 error in terms of total variation norm and also in terms of observed Kullback-Leibler divergence when the conditional distribution of X|Z is misspecified. We validate our theoretical results by extensive simulations and show that our new method has considerable advantages over other existing conditional sampling based methods when we take both power and computational efficiency into consideration.


title: Exploring $HVV$ amplitudes with $CP$ violation by decomposition and on-shell scattering amplitude methods

abstract: $CP$ violation may play an important role in Baryogenesis in early universe, and should be examined at colliders comprehensively. We study $CP$ properties of $HVV$ vertexes between Higgs and gauge boson pairs with defining a $CP$ violation phase angle $\xi$, which indicates the mixture of $CP$-even and $CP$-odd Higgs states in $HVV$ in new physics. A series of $HVV$ amplitudes $H\to\gamma\gamma, H\to\gamma V\to \gamma \ell\ell$, and $H\to VV\to 4\ell$ with $CP$ phase angle are studied systematically, which explains explicitly why $CP$ violation could only be probed in $4\ell$ process independently. We get a novel amplitude decomposition relation which illustrates if two preconditions (multilinear momentum dependent vertexes and current $J_\mu$ of $V\to \ell^+ \ell^-$ is formally proportional to a photon's polarization vector) are satisfied, an high-point amplitude can be decomposed into a summation of a series of low-point amplitudes. As a practical example, the amplitude of $H\to\gamma V\to \gamma \ell\ell$, and $H\to VV\to 4\ell$ processes can be decomposed into summation of many $H\to\gamma\gamma$ amplitudes. Meanwhile, we calculate these amplitudes in the framework of on-shell scattering amplitude method, with considering both massless and massive vector gauge bosons with $CP$ violation phase angle. The above two approaches provides consistent results and exhibit clearly the $CP$ violation $\xi$ dependence in the amplitudes.


title: Ranking Distance Calibration for Cross-Domain Few-Shot Learning

abstract: Recent progress in few-shot learning promotes a more realistic cross-domain setting, where the source and target datasets are from different domains. Due to the domain gap and disjoint label spaces between source and target datasets, their shared knowledge is extremely limited. This encourages us to explore more information in the target domain rather than to overly elaborate training strategies on the source domain as in many existing methods. Hence, we start from a generic representation pre-trained by a cross-entropy loss and a conventional distance-based classifier, along with an image retrieval view, to employ a re-ranking process for calibrating a target distance matrix by discovering the reciprocal k-nearest neighbours within the task. Assuming the pre-trained representation is biased towards the source, we construct a non-linear subspace to minimise task-irrelevant features therewithin while keep more transferrable discriminative information by a hyperbolic tangent transformation. The calibrated distance in this target-aware non-linear subspace is complementary to that in the pre-trained representation. To impose such distance calibration information onto the pre-trained representation, a Kullback-Leibler divergence loss is employed to gradually guide the model towards the calibrated distance-based distribution. Extensive evaluations on eight target domains show that this target ranking calibration process can improve conventional distance-based classifiers in few-shot learning.


title: A physicist-friendly reformulation of the Atiyah-Patodi-Singer index (on a lattice)

abstract: The Atiyah-Singer index theorem on a closed manifold is well understood and appreciated in physics. On the other hand, the Atiyah-Patodi-Singer index, which is an extension to a manifold with boundary, is physicist-unfriendly, in that it is formulated with a nonlocal boundary condition. Recently we proved that the same index as APS is obtained from the domain-wall fermion Dirac operator. Our theorem indicates that the index can be expressed without any nonlocal conditions, in such a physicist-friendly way that application to the lattice gauge theory is straightforward. The domain-wall fermion provides a natural mathematical foundation for understanding the bulk-edge correspondence of the anomaly inflow.


title: A Blockchain-Enabled Incentivised Framework for Cyber Threat Intelligence Sharing in ICS

abstract: In recent years Industrial Control Systems (ICS) have been targeted increasingly by sophisticated cyberattacks. Improving ICS security has drawn significant attention in the literature that emphasises the importance of Cyber Threat Intelligence (CTI) sharing in accelerating detection, mitigation, and prevention of cyberattacks. However, organisations are reluctant to exchange CTI due to fear of exposure, reputational damage, and lack of incentives. Furthermore, there has been limited discussion about the factors influencing participation in sharing CTI about ICS. The existing CTI-sharing platforms rely on centralised trusted architectures that suffer from a single point of failure and risk companies' privacy as the central node maintains CTI details. In this paper, we address the needs of organisations involved in the management and protection of ICS and present a novel framework that facilitates secure, private, and incentivised exchange of CTI related to ICS using blockchain. We propose a new blockchain-enabled framework that facilitates the secure dissemination of CTI data among multiple stakeholders in ICS. We provide the framework design, technical development and evaluate the framework's feasibility in a real-world application environment using practical use-case scenarios. Our proposed design shows a more practical and efficient framework for a CTI sharing network for ICS, including the bestowal and acknowledgment of data privacy, trust barriers, and security issues ingrained in this domain.


title: GLocal: Global Graph Reasoning and Local Structure Transfer for Person Image Generation

abstract: In this paper, we focus on person image generation, namely, generating person image under various conditions, e.g., corrupted texture or different pose. To address texture occlusion and large pose misalignment in this task, previous works just use the corresponding region's style to infer the occluded area and rely on point-wise alignment to reorganize the context texture information, lacking the ability to globally correlate the region-wise style codes and preserve the local structure of the source. To tackle these problems, we present a GLocal framework to improve the occlusion-aware texture estimation by globally reasoning the style inter-correlations among different semantic regions, which can also be employed to recover the corrupted images in texture inpainting. For local structural information preservation, we further extract the local structure of the source image and regain it in the generated image via local structure transfer. We benchmark our method to fully characterize its performance on DeepFashion dataset and present extensive ablation studies that highlight the novelty of our method.


title: Hereditary atomicity in integral domains

abstract: If every subring of an integral domain is atomic, then we say that the latter is hereditarily atomic. In this paper, we study hereditarily atomic domains. First, we characterize when certain direct limits of Dedekind domains are Dedekind domains in terms of atomic overrings. Then we use this characterization to determine the fields that are hereditarily atomic. On the other hand, we investigate hereditary atomicity in the context of rings of polynomials and rings of Laurent polynomials, characterizing the fields and rings whose rings of polynomials and rings of Laurent polynomials, respectively, are hereditarily atomic. As a result, we obtain two classes of hereditarily atomic domains that cannot be embedded into any hereditarily atomic field. By contrast, we show that rings of power series are never hereditarily atomic. Finally, we make some progress on the still open question of whether every subring of a hereditarily atomic domain satisfies ACCP.


title: Training BatchNorm Only in Neural Architecture Search and Beyond

abstract: This work investigates the usage of batch normalization in neural architecture search (NAS). Specifically, Frankle et al. find that training BatchNorm only can achieve nontrivial performance. Furthermore, Chen et al. claim that training BatchNorm only can speed up the training of the one-shot NAS supernet over ten times. Critically, there is no effort to understand 1) why training BatchNorm only can find the perform-well architectures with the reduced supernet-training time, and 2) what is the difference between the train-BN-only supernet and the standard-train supernet. We begin by showing that the train-BN-only networks converge to the neural tangent kernel regime, obtain the same training dynamics as train all parameters theoretically. Our proof supports the claim to train BatchNorm only on supernet with less training time. Then, we empirically disclose that train-BN-only supernet provides an advantage on convolutions over other operators, cause unfair competition between architectures. This is due to only the convolution operator being attached with BatchNorm. Through experiments, we show that such unfairness makes the search algorithm prone to select models with convolutions. To solve this issue, we introduce fairness in the search space by placing a BatchNorm layer on every operator. However, we observe that the performance predictor in Chen et al. is inapplicable on the new search space. To this end, we propose a novel composite performance indicator to evaluate networks from three perspectives: expressivity, trainability, and uncertainty, derived from the theoretical property of BatchNorm. We demonstrate the effectiveness of our approach on multiple NAS-benchmarks (NAS-Bench101, NAS-Bench-201) and search spaces (DARTS search space and MobileNet search space).


title: Differential operators, retracts, and toric face rings

abstract: We give explicit descriptions of rings of differential operators of toric face rings in characteristic $0$. For quotients of normal affine semigroup rings by radical monomial ideals, we also identify which of their differential operators are induced by differential operators on the ambient ring. Lastly, we provide a criterion for the Gorenstein property of a normal affine semigroup ring in terms of its differential operators. Our main technique is to realize the k-algebras we study in terms of a suitable family of their algebra retracts in a way that is compatible with the characterization of differential operators. This strategy allows us to describe differential operators of any k-algebra realized by retracts in terms of the differential operators on these retracts, without restriction on char(k).


title: CAMA: Energy and Memory Efficient Automata Processing in Content-Addressable Memories

abstract: Accelerating finite automata processing is critical for advancing real-time analytic in pattern matching, data mining, bioinformatics, intrusion detection, and machine learning. Recent in-memory automata accelerators leveraging SRAMs and DRAMs have shown exciting improvements over conventional digital designs. However, the bit-vector representation of state transitions used by all SOTA designs is only optimal in processing worst-case completely random patterns, while a significant amount of memory and energy is wasted in running most real-world benchmarks. We present CAMA, a Content-Addressable Memory (CAM) enabled Automata accelerator for processing homogeneous non-deterministic finite automata (NFA). A radically different state representation scheme, along with co-designed novel circuits and data encoding schemes, greatly reduces energy, memory, and chip area for most realistic NFAs. CAMA is holistically optimized with the following major contributions: (1) a 16x256 8-transistor (8T) CAM array for state matching, replacing the 256x256 6T SRAM array or two 16x256 6T SRAM banks in SOTA designs; (2) a novel encoding scheme that enables content searching within 8T SRAMs and adapts to different applications; (3) a reconfigurable and scalable architecture that improves efficiency on all tested benchmarks, without losing support for any NFA that is compatible with SOTA designs; (4) an optimization framework that automates the choice of encoding schemes and maps a given NFA to the proposed hardware. Two versions of CAMA, one optimized for energy (CAMA-E) and the other for throughput (CAMA-T), are comprehensively evaluated in a 28nm CMOS process, and across 21 real-world and synthetic benchmarks. CAMA-E achieves 2.1x, 2.8x, and 2.04x lower energy than CA, 2-stride Impala, and eAP. CAMA-T shows 2.68x, 3.87x and 2.62x higher average compute density than 2-stride Impala, CA, and eAP.