title: Online Re-Planning and Adaptive Parameter Update for Multi-Agent Path Finding with Stochastic Travel Times

abstract: This study explores the problem of Multi-Agent Path Finding with continuous and stochastic travel times whose probability distribution is unknown. Our purpose is to manage a group of automated robots that provide package delivery services in a building where pedestrians and a wide variety of robots coexist, such as delivery services in office buildings, hospitals, and apartments. It is often the case with these real-world applications that the time required for the robots to traverse a corridor takes a continuous value and is randomly distributed, and the prior knowledge of the probability distribution of the travel time is limited. Multi-Agent Path Finding has been widely studied and applied to robot management systems; however, automating the robot operation in such environments remains difficult. We propose 1) online re-planning to update the action plan of robots while it is executed, and 2) parameter update to estimate the probability distribution of travel time using Bayesian inference as the delay is observed. We use a greedy heuristic to obtain solutions in a limited computation time. Through simulations, we empirically compare the performance of our method to those of existing methods in terms of the conflict probability and the actual travel time of robots. The simulation results indicate that the proposed method can find travel paths with at least 50% fewer conflicts and a shorter actual total travel time than existing methods. The proposed method requires a small number of trials to achieve the performance because the parameter update is prioritized on the important edges for path planning, thereby satisfying the requirements of quick implementation of robust planning of automated delivery services.


title: The $RO(C_{2^n})$-graded homotopy of $H\underline{\mathbb{F}_2}$

abstract: We give an explicit formula for the $RO(C_{2^n})$-graded homotopy of $H\underline{\mathbb{F}_2}$.


title: DiSProD: Differentiable Symbolic Propagation of Distributions for Planning

abstract: The paper introduces DiSProD, an online planner developed for environments with probabilistic transitions in continuous state and action spaces. DiSProD builds a symbolic graph that captures the distribution of future trajectories, conditioned on a given policy, using independence assumptions and approximate propagation of distributions. The symbolic graph provides a differentiable representation of the policy's value, enabling efficient gradient-based optimization for long-horizon search. The propagation of approximate distributions can be seen as an aggregation of many trajectories, making it well-suited for dealing with sparse rewards and stochastic environments. An extensive experimental evaluation compares DiSProD to state-of-the-art planners in discrete-time planning and real-time control of robotic systems. The proposed method improves over existing planners in handling stochastic environments, sensitivity to search depth, sparsity of rewards, and large action spaces. Additional real-world experiments demonstrate that DiSProD can control ground vehicles and surface vessels to successfully navigate around obstacles.


title: Quantum Transport in Graphene Using Surface Acoustic Wave Resonators

abstract: Surface acoustic waves (SAWs) provide a contactless method for measuring the wavevector-dependent conductivity. This technique has been used to discover emergent length scales in the fractional quantum Hall regime of traditional, semiconductor-based heterostructures. SAWs would appear to be an ideal match for van der Waals (vdW) heterostructures, but the right combination of substrate and experimental geometry to allow access to the quantum transport regime has not yet been found. We demonstrate that SAW resonant cavities fabricated on LiNbO$_3$ substrates can be used to access the quantum Hall regime of high-mobility, hexagonal boron nitride (hBN) encapsulated graphene heterostructures. Our work establishes SAW resonant cavities as a viable platform for performing contactless conductivity measurements in the quantum transport regime of vdW materials.


title: Deep Learning (DL)-based Automatic Segmentation of the Internal Pudendal Artery (IPA) for Reduction of Erectile Dysfunction in Definitive Radiotherapy of Localized Prostate Cancer

abstract: Background and purpose: Radiation-induced erectile dysfunction (RiED) is commonly seen in prostate cancer patients. Clinical trials have been developed in multiple institutions to investigate whether dose-sparing to the internal-pudendal-arteries (IPA) will improve retention of sexual potency. The IPA is usually not considered a conventional organ-at-risk (OAR) due to segmentation difficulty. In this work, we propose a deep learning (DL)-based auto-segmentation model for the IPA that utilizes CT and MRI or CT alone as the input image modality to accommodate variation in clinical practice. Materials and methods: 86 patients with CT and MRI images and noisy IPA labels were recruited in this study. We split the data into 42/14/30 for model training, testing, and a clinical observer study, respectively. There were three major innovations in this model: 1) we designed an architecture with squeeze-and-excite blocks and modality attention for effective feature extraction and production of accurate segmentation, 2) a novel loss function was used for training the model effectively with noisy labels, and 3) modality dropout strategy was used for making the model capable of segmentation in the absence of MRI. Results: The DSC, ASD, and HD95 values for the test dataset were 62.2%, 2.54mm, and 7mm, respectively. AI segmented contours were dosimetrically equivalent to the expert physician's contours. The observer study showed that expert physicians' scored AI contours (mean=3.7) higher than inexperienced physicians' contours (mean=3.1). When inexperienced physicians started with AI contours, the score improved to 3.7. Conclusion: The proposed model achieved good quality IPA contours to improve uniformity of segmentation and to facilitate introduction of standardized IPA segmentation into clinical trials and practice.


title: Observation of flat-band localization and topological edge states induced by effective strong interactions in electrical circuit networks

abstract: Flat-band topologies and localizations in non-interacting systems are extensively studied in different quantum and classical-wave systems. Recently, the exploration on the novel physics of flat-band localizations and topologies in interacting systems has aroused great interest. In particular, it is theoretically shown that the strong-interaction could drive the formation of nontrivial topological flat bands, even dispersive trivial bands dominate the single-particle counterparts. However, the experimental observation of those interesting phenomena is still lacking. Here, we experimentally simulate the interaction-induced flat-band localizations and topological edge states in electrical circuit networks. We directly map the eigenstates of two correlated bosons in one-dimensional Aharonov Bohm cages to modes of two-dimensional circuit lattices.In this case, the two-boson flat-bands and topological edge states are detected by measuring frequency-dependent impedance responses and voltage dynamics in the time domain. Our finding suggests a flexible platform to simulate the interaction-induced flat-band topology, and may possess potential applications in designing novel electronic devices.


title: Characterization of Quantum Frequency Processors

abstract: Frequency-bin qubits possess unique synergies with wavelength-multiplexed lightwave communications, suggesting valuable opportunities for quantum networking with the existing fiber-optic infrastructure. Although the coherent manipulation of frequency-bin states requires highly controllable multi-spectral-mode interference, the quantum frequency processor (QFP) provides a scalable path for gate synthesis leveraging standard telecom components. Here we summarize the state of the art in experimental QFP characterization. Distinguishing between physically motivated ''open box'' approaches that treat the QFP as a multiport interferometer, and ''black box'' approaches that view the QFP as a general quantum operation, we highlight the assumptions and results of multiple techniques, including quantum process tomography of a tunable beamsplitter -- to our knowledge the first full process tomography of any frequency-bin operation. Our findings should inform future characterization efforts as the QFP increasingly moves beyond proof-of-principle tabletop demonstrations toward integrated devices and deployed quantum networking experiments.


title: Efficient Domain Adaptation for Speech Foundation Models

abstract: Foundation models (FMs), that are trained on broad data at scale and are adaptable to a wide range of downstream tasks, have brought large interest in the research community. Benefiting from the diverse data sources such as different modalities, languages and application domains, foundation models have demonstrated strong generalization and knowledge transfer capabilities. In this paper, we present a pioneering study towards building an efficient solution for FM-based speech recognition systems. We adopt the recently developed self-supervised BEST-RQ for pretraining, and propose the joint finetuning with both source and unsupervised target domain data using JUST Hydra. The FM encoder adapter and decoder are then finetuned to the target domain with a small amount of supervised in-domain data. On a large-scale YouTube and Voice Search task, our method is shown to be both data and model parameter efficient. It achieves the same quality with only 21.6M supervised in-domain data and 130.8M finetuned parameters, compared to the 731.1M model trained from scratch on additional 300M supervised in-domain data.


title: Gradient Estimation for Unseen Domain Risk Minimization with Pre-Trained Models

abstract: Domain generalization aims to build generalized models that perform well on unseen domains when only source domains are available for model optimization. Recent studies have shown that large-scale pre-trained models can enhance domain generalization by leveraging their generalization power. However, these pre-trained models lack target task-specific knowledge yet due to discrepancies between the pre-training objectives and the target task. Although the task-specific knowledge could be learned from source domains by fine-tuning, this hurts the generalization power of pre-trained models due to gradient bias toward the source domains. To alleviate this problem, we propose a new domain generalization method that estimates unobservable gradients that reduce potential risks in unseen domains using a large-scale pre-trained model. These estimated unobservable gradients allow the pre-trained model to learn task-specific knowledge further while preserving its generalization ability by relieving the gradient bias. Our experimental results show that our method outperforms baseline methods on DomainBed, a standard benchmark in domain generalization. We also provide extensive analyses to demonstrate that the pre-trained model can learn task-specific knowledge without sacrificing its generalization power.


title: Equilibrium transport with time-inconsistent costs: An application to matching problems in the job market

abstract: Given two probability measures on sequential data, we investigate the transport problem with time-inconsistent preferences under a discrete-time setting. Motivating examples are nonlinear objectives, state-dependent costs, and regularized optimal transport with general $f$-divergence. Under the bicausal constraint, we introduce the concept of equilibrium transport. The existence is proved in the semi-discrete Markovian case and the continuous non-Markovian case with strict quasiconvexity, while the uniqueness also holds in the second case. We apply our framework to study inertia of two job markets, top-ranking executives and academia. The empirical analysis shows that a job market with stronger inertia is less efficient. The University of California (UC) postdoc job market has the strongest inertia even than that of executives, while there is no evidence of inertia in the UC faculty job market.


title: Qi standard metasurface for free-positioning and multi-device supportive wireless power transfer

abstract: Free-positioning and multi-user supportive wireless power transfer systems represent the next-generation technology for wireless charging under the Qi standard. Traditional approaches employ multiple transmitting coils and multi-channel driving circuits with active control algorithms to achieve these goals. However, these traditional approaches are significantly limited by cost, weight, and heating due to their relatively low efficiency. Here, we demonstrate an innovative approach by using a metasurface to achieve free-positioning and multi-user compatibility. The metasurface works as a passive device to reform the magnetic field and enables high-efficiency free-positioning wireless power transfer with only a single transmitting coil. It shows up to 4.6 times improvement in efficiency. The metasurface also increases the coverage area from around 5 cm by 5 cm with over 40% efficiency to around 10 cm by 10 cm with over 70% efficiency. We further show that the system can support multiple receivers. Besides increasing the overall efficiency, we demonstrate tuning the power division between the multiple receivers, enabling compensation of receivers of different sizes to achieve their desired power.


title: Spiking Synaptic Penalty: Appropriate Penalty Term for Energy-Efficient Spiking Neural Networks

abstract: Spiking neural networks (SNNs) are energy-efficient neural networks because of their spiking nature. However, as the spike firing rate of SNNs increases, the energy consumption does as well, and thus, the advantage of SNNs diminishes. Here, we tackle this problem by introducing a novel penalty term for the spiking activity into the objective function in the training phase. Our method is designed so as to optimize the energy consumption metric directly without modifying the network architecture. Therefore, the proposed method can reduce the energy consumption more than other methods while maintaining the accuracy. We conducted experiments for image classification tasks, and the results indicate the effectiveness of the proposed method, which mitigates the dilemma of the energy--accuracy trade-off.


title: ANTM: An Aligned Neural Topic Model for Exploring Evolving Topics

abstract: This paper presents an algorithmic family of dynamic topic models called Aligned Neural Topic Models (ANTM), which combine novel data mining algorithms to provide a modular framework for discovering evolving topics. ANTM maintains the temporal continuity of evolving topics by extracting time-aware features from documents using advanced pre-trained Large Language Models (LLMs) and employing an overlapping sliding window algorithm for sequential document clustering. This overlapping sliding window algorithm identifies a different number of topics within each time frame and aligns semantically similar document clusters across time periods. This process captures emerging and fading trends across different periods and allows for a more interpretable representation of evolving topics. Experiments on four distinct datasets show that ANTM outperforms probabilistic dynamic topic models in terms of topic coherence and diversity metrics. Moreover, it improves the scalability and flexibility of dynamic topic models by being accessible and adaptable to different types of algorithms. Additionally, a Python package is developed for researchers and scientists who wish to study the trends and evolving patterns of topics in large-scale textual data.


title: Search for the Sagittarius Tidal Stream of Axion Dark Matter around 4.55 $\mu$eV

abstract: We report the first search for the Sagittarius tidal stream of axion dark matter around 4.55 $\mu$eV using CAPP-12TB haloscope data acquired in March of 2022. Our result excluded the Sagittarius tidal stream of Dine-Fischler-Srednicki-Zhitnitskii and Kim-Shifman-Vainshtein-Zakharov axion dark matter densities of $\rho_a\gtrsim0.184$ and $\gtrsim0.025$ GeV/cm$^{3}$, respectively, over a mass range from 4.51 to 4.59 $\mu$eV at a 90% confidence level.


title: LazyGNN: Large-Scale Graph Neural Networks via Lazy Propagation

abstract: Recent works have demonstrated the benefits of capturing long-distance dependency in graphs by deeper graph neural networks (GNNs). But deeper GNNs suffer from the long-lasting scalability challenge due to the neighborhood explosion problem in large-scale graphs. In this work, we propose to capture long-distance dependency in graphs by shallower models instead of deeper models, which leads to a much more efficient model, LazyGNN, for graph representation learning. Moreover, we demonstrate that LazyGNN is compatible with existing scalable approaches (such as sampling methods) for further accelerations through the development of mini-batch LazyGNN. Comprehensive experiments demonstrate its superior prediction performance and scalability on large-scale benchmarks. The implementation of LazyGNN is available at https://github.com/RXPHD/Lazy_GNN.


title: Interface-tuning of ferroelectricity and quadruple-well state in CuInP$_2$S$_6$ via ferroelectric oxide

abstract: Ferroelectric van der Waals CuInP$_2$S$_6$ possesses intriguing quadruple-well states and negative piezoelectricity. Its technological implementation has been impeded by the relatively low Curie temperature (bulk $T_C$ ~42 {\deg}C) and the lack of precise domain control. Here we show that CuInP$_2$S$_6$ can be immune to the finite size effect and exhibits enhanced ferroelectricity, piezoelectricity, and polar alignment in the ultrathin limit when interfaced with ferroelectric oxide PbZr$_{0.2}$Ti$_{0.8}$O$_3$ films. Piezoresponse force microscopy studies reveal that the polar domains in thin CuInP$_2$S$_6$ fully conform to those of underlying PbZr$_{0.2}$Ti$_{0.8}$O$_3$, where the piezoelectric coefficient changes sign and increases sharply with reducing thickness. High temperature $in$ $situ$ domain imaging points to a significantly enhanced $T_C$ exceeding 200 {\deg}C for 13 nm CuInP$_2$S$_6$ on PbZr$_{0.2}$Ti$_{0.8}$O$_3$. Density functional theory modeling and Monte Carlo simulations show that the enhanced polar alignment and $T_C$ can be attributed to interface-mediated structure distortion in CuInP$_2$S$_6$. Our study provides an effective material strategy to engineer the polar properties of CuInP$_2$S$_6$ for flexible nanoelectronic, optoelectronic, and mechanical applications.


title: Closed-Form Solution for Scaling a Wireless Acoustic Sensor Network

abstract: This study presents a closed-form solution for localizing and synchronizing an acoustic sensor node with respect to a Wireless Acoustic Sensor Network (WASN). The aim is to allow efficient scaling of a WASN by individually calibrating newly joined sensor nodes instead of recalibrating the entire array. A key contribution is that the sensor to be calibrated does not need to include a built-in emitter. The proposed method uses signals emitted from spatially distributed sources to compute time difference of arrival (TDOA) measurements between the existing WASN and a new sensor. The problem is then modeled as a set of multivariate nonlinear TDOA equations. Through a simple transformation, the nonlinear TDOA equations are converted into a system of linear equations. Then, weighted least squares (WLS) is applied to find an accurate estimate of the calibration parameters. Signal sources can either be known emitters within the existing WASN or arbitrary sources in the environment, thus allowing for flexible applicability in both active and passive calibration scenarios. Simulation results under various conditions show high joint localization and synchronization performance, often comparable to the Cram\'er-Rao lower bound (CRLB).


title: Highly Rectifying Conical Nanopores in Amorphous SiO2 Membranes for Nanofluidic Osmotic Power Generation and Electroosmotic Pumps

abstract: Nanopore membranes are a versatile platform for a wide range of applications ranging from medical sensing to filtration and clean energy generation. To attain high-flux rectifying ionic flow, it is required to produce short channels exhibiting asymmetric surface charge distributions. This work reports on a system of track etched conical nanopores in amorphous SiO$_2$ membranes, fabricated using the scalable track etch technique. Pores are fabricated by irradiation of 1 $\mu$m thick SiO$_2$ windows with 2.2 GeV $^{197}$Au ions and subsequent chemical etching. Structural characterisation is performed using atomic force microscopy (AFM), scanning electron microscopy (SEM), small angle X-ray scattering (SAXS), ellipsometry, and surface profiling. Conductometric characterisation of the pore surface is performed using a membrane containing 16 pores, including an in-depth analysis of ionic transport characteristics. The pores have a tip radius of (5.7 $\pm$ 0.1) nm, a half-cone angle of (12.6 $\pm$ 0.1)$^{\circ}$, and a length of (710 $\pm$ 5) nm. The $pK_a$, $pK_b$, and $pI$ are determined to 7.6 $\pm$ 0.1, 1.5 $\pm$ 0.2, and 4.5 $\pm$ 0.1, respectively, enabling the fine-tuning of the surface charge density between +100 and -300 mC $m^{-2}$ and allowing to achieve an ionic current rectification ratio of up to 10. This highly versatile technology addresses challenges that contemporary nanopore systems face, and offers a platform to improve the performance of existing applications.


title: Revisiting Long-tailed Image Classification: Survey and Benchmarks with New Evaluation Metrics

abstract: Recently, long-tailed image classification harvests lots of research attention, since the data distribution is long-tailed in many real-world situations. Piles of algorithms are devised to address the data imbalance problem by biasing the training process towards less frequent classes. However, they usually evaluate the performance on a balanced testing set or multiple independent testing sets having distinct distributions with the training data. Considering the testing data may have arbitrary distributions, existing evaluation strategies are unable to reflect the actual classification performance objectively. We set up novel evaluation benchmarks based on a series of testing sets with evolving distributions. A corpus of metrics are designed for measuring the accuracy, robustness, and bounds of algorithms for learning with long-tailed distribution. Based on our benchmarks, we re-evaluate the performance of existing methods on CIFAR10 and CIFAR100 datasets, which is valuable for guiding the selection of data rebalancing techniques. We also revisit existing methods and categorize them into four types including data balancing, feature balancing, loss balancing, and prediction balancing, according the focused procedure during the training pipeline.


title: Applications of Absorptive Reconfigurable Intelligent Surfaces in Interference Mitigation and Physical Layer Security

abstract: This paper explores the use of reconfigurable intelligent surfaces (RIS) in mitigating cross-system interference in spectrum sharing and secure wireless applications. Unlike conventional RIS that can only adjust the phase of the incoming signal and essentially reflect all impinging energy, or active RIS, which also amplify the reflected signal at the cost of significantly higher complexity, noise, and power consumption, an absorptive RIS (ARIS) is considered. An ARIS can in principle modify both the phase and modulus of the impinging signal by absorbing a portion of the signal energy, providing a compromise between its conventional and active counterparts in terms of complexity, power consumption, and degrees of freedom (DoFs). We first use a toy example to illustrate the benefit of ARIS, and then we consider three applications: (1) Spectral coexistence of radar and communication systems, where a convex optimization problem is formulated to minimize the Frobenius norm of the channel matrix from the communication base station to the radar receiver; (2) Spectrum sharing in device-to-device (D2D) communications, where a max-min scheme that maximizes the worst-case signal-to-interference-plus-noise ratio (SINR) among the D2D links is developed and then solved via fractional programming; (3) The physical layer security of a downlink communication system, where the secrecy rate is maximized and the resulting nonconvex problem is solved by a fractional programming algorithm together with a sequential convex relaxation procedure. Numerical results are then presented to show the significant benefit of ARIS in these applications.


title: Double-exponential susceptibility growth in Dyson's hierarchical model with $|x-y|^{-2}$ interaction

abstract: We study long-range percolation on the $d$-dimensional hierarchical lattice, in which each possible edge $\{x,y\}$ is included independently at random with inclusion probability $1-\exp ( -\beta \|x-y\|^{-d-\alpha} )$, where $\alpha>0$ is fixed and $\beta\geq 0$ is a parameter. This model is known to have a phase transition at some $\beta_c<\infty$ if and only if $\alpha<d$. We study the model in the regime $\alpha \geq d$, in which $\beta_c=\infty$, and prove that the susceptibility $\chi(\beta)$ (i.e., the expected volume of the cluster at the origin) satisfies \[ \chi(\beta) = \beta^{\frac{d}{\alpha - d } - o(1)} \qquad \text{as $\beta \to \infty$ if $\alpha > d$} \qquad \text{and} \qquad e^{e^{ \Theta(\beta) }} \qquad \text{as $\beta \to \infty$ if $\alpha = d$.} \] This resolves a problem raised by Georgakopoulos and Haslegrave (2020), who showed that $\chi(\beta)$ grows between exponentially and double-exponentially when $\alpha=d$. Our results imply that analogous results hold for a number of related models including Dyson's hierarchical Ising model, for which the double-exponential susceptibility growth we establish appears to be a new phenomenon even at the heuristic level.


title: An AsFem implementation for quasi-static brittle fracture phase field model

abstract: Phase field method has been widely used because of its excellent ability to simulate fracture problems. At present, the implementation process is mainly based on commercial software, and the operation process is relatively complex. In this paper, 2D and 3D phase field models are implemented in the open-source finite element software package AsFem. Compared with commercial software, it is simpler to realize phase field fracture model in AsFem. At the same time, a robust staggered scheme and an efficient monolithic scheme can be used to solve the displacement field and phase field sub-problem, and the transformation process is very easy. Several examples are tested to demonstrate the performance of the current implementation. The simulation results are in good agreement with the previous work, which shows the feasibility and effectiveness of implementing the phase field method in AsFem. In the future, more complex multi-field coupled phase field fracture problems can be solved with AsFem.


title: Randomized Gaussian Process Upper Confidence Bound with Tighter Bayesian Regret Bounds

abstract: Gaussian process upper confidence bound (GP-UCB) is a theoretically promising approach for black-box optimization; however, the confidence parameter $\beta$ is considerably large in the theorem and chosen heuristically in practice. Then, randomized GP-UCB (RGP-UCB) uses a randomized confidence parameter, which follows the Gamma distribution, to mitigate the impact of manually specifying $\beta$. This study first generalizes the regret analysis of RGP-UCB to a wider class of distributions, including the Gamma distribution. Furthermore, we propose improved RGP-UCB (IRGP-UCB) based on a two-parameter exponential distribution, which achieves tighter Bayesian regret bounds. IRGP-UCB does not require an increase in the confidence parameter in terms of the number of iterations, which avoids over-exploration in the later iterations. Finally, we demonstrate the effectiveness of IRGP-UCB through extensive experiments.


title: Spectral Aware Softmax for Visible-Infrared Person Re-Identification

abstract: Visible-infrared person re-identification (VI-ReID) aims to match specific pedestrian images from different modalities. Although suffering an extra modality discrepancy, existing methods still follow the softmax loss training paradigm, which is widely used in single-modality classification tasks. The softmax loss lacks an explicit penalty for the apparent modality gap, which adversely limits the performance upper bound of the VI-ReID task. In this paper, we propose the spectral-aware softmax (SA-Softmax) loss, which can fully explore the embedding space with the modality information and has clear interpretability. Specifically, SA-Softmax loss utilizes an asynchronous optimization strategy based on the modality prototype instead of the synchronous optimization based on the identity prototype in the original softmax loss. To encourage a high overlapping between two modalities, SA-Softmax optimizes each sample by the prototype from another spectrum. Based on the observation and analysis of SA-Softmax, we modify the SA-Softmax with the Feature Mask and Absolute-Similarity Term to alleviate the ambiguous optimization during model training. Extensive experimental evaluations conducted on RegDB and SYSU-MM01 demonstrate the superior performance of the SA-Softmax over the state-of-the-art methods in such a cross-modality condition.


title: Towards Practical Preferential Bayesian Optimization with Skew Gaussian Processes

abstract: We study preferential Bayesian optimization (BO) where reliable feedback is limited to pairwise comparison called duels. An important challenge in preferential BO, which uses the preferential Gaussian process (GP) model to represent flexible preference structure, is that the posterior distribution is a computationally intractable skew GP. The most widely used approach for preferential BO is Gaussian approximation, which ignores the skewness of the true posterior. Alternatively, Markov chain Monte Carlo (MCMC) based preferential BO is also proposed. In this work, we first verify the accuracy of Gaussian approximation, from which we reveal the critical problem that the predictive probability of duels can be inaccurate. This observation motivates us to improve the MCMC-based estimation for skew GP, for which we show the practical efficiency of Gibbs sampling and derive the low variance MC estimator. However, the computational time of MCMC can still be a bottleneck in practice. Towards building a more practical preferential BO, we develop a new method that achieves both high computational efficiency and low sample complexity, and then demonstrate its effectiveness through extensive numerical experiments.


title: Three-dimensional Global Simulations of Type-II Planet-disk Interaction with a Magnetized Disk Wind: I. Magnetic Flux Concentration and Gap Properties

abstract: Giant planets embedded in protoplanetary disks (PPDs) can create annulus density gaps around their orbits in the type-II regime, potentially responsible for the ubiquity of annular substructures observed in PPDs. Despite of substantial amount of works studying type-II planet migration and gap properties, they are almost exclusively conducted under the viscous accretion disk framework. However, recent studies have established magnetized disk winds as the primary driving disk accretion and evolution, which can co-exist with turbulence from the magneto-rotational instability (MRI) in the outer PPDs. We conduct a series of 3D global non-ideal magneto-hydrodynamic (MHD) simulations of type-II planet-disk interaction applicable to the outer PPDs. Our simulations properly resolve the MRI turbulence and accommodate the MHD disk wind. We found that the planet triggers the poloidal magnetic flux concentration around its orbit. The concentrated magnetic flux strongly enhances angular momentum removal in the gap, which is along the inclined poloidal field through a strong outflow emanating from the disk surface outward of the planet gap. The resulting planet-induced gap shape is more similar to an inviscid disk, while being much deeper, which can be understood from a simple inhomogeneous wind torque prescription. The corotation region is characterized by a fast trans-sonic accretion flow that is asymmetric in azimuth about the planet and lacking the horseshoe turns, and the meridional flow is weakened. The torque acting on the planet generally drives inward migration, though the migration rate can be affected by the presence of neighboring gaps through stochastic, planet-free magnetic flux concentration.


title: UVIT observations of the Small Magellanic Cloud: Point source catalogue

abstract: Three fields in the outskirts of the Small Magellanic Cloud were observed by the Ultra-Violet Imaging Telescope (UVIT) on board AstroSat, during 31 December 2017 and 01 January 2018. The observations were carried out on a total of seven filters, three in the far ultra-violet (FUV; 1300$-$1800 \r{A}) band and four in the near ultra-violet (NUV; 2000$-$3000 \r{A}) band. We carried out photometry of these observations that have a spatial resolution better than 1.5$^{\prime\prime}$. We present here the first results of this work, which is a matched catalogue of 11,241 sources detected in three FUV and four NUV wavelengths. We make the catalogue available online, which would be of use to the astronomical community to address a wide variety of astrophysical problems. We provide an expression to estimate the total count rate in the full point spread function of UVIT that also incorporate the effect of saturation.


title: Class Overwhelms: Mutual Conditional Blended-Target Domain Adaptation

abstract: Current methods of blended targets domain adaptation (BTDA) usually infer or consider domain label information but underemphasize hybrid categorical feature structures of targets, which yields limited performance, especially under the label distribution shift. We demonstrate that domain labels are not directly necessary for BTDA if categorical distributions of various domains are sufficiently aligned even facing the imbalance of domains and the label distribution shift of classes. However, we observe that the cluster assumption in BTDA does not comprehensively hold. The hybrid categorical feature space hinders the modeling of categorical distributions and the generation of reliable pseudo labels for categorical alignment. To address these, we propose a categorical domain discriminator guided by uncertainty to explicitly model and directly align categorical distributions $P(Z|Y)$. Simultaneously, we utilize the low-level features to augment the single source features with diverse target styles to rectify the biased classifier $P(Y|Z)$ among diverse targets. Such a mutual conditional alignment of $P(Z|Y)$ and $P(Y|Z)$ forms a mutual reinforced mechanism. Our approach outperforms the state-of-the-art in BTDA even compared with methods utilizing domain labels, especially under the label distribution shift, and in single target DA on DomainNet. Source codes are available at \url{https://github.com/Pengchengpcx/Class-overwhelms-Mutual-Conditional-Blended-Target-Domain-Adaptation}.


title: Pseudonorm Approachability and Applications to Regret Minimization

abstract: Blackwell's celebrated approachability theory provides a general framework for a variety of learning problems, including regret minimization. However, Blackwell's proof and implicit algorithm measure approachability using the $\ell_2$ (Euclidean) distance. We argue that in many applications such as regret minimization, it is more useful to study approachability under other distance metrics, most commonly the $\ell_\infty$-metric. But, the time and space complexity of the algorithms designed for $\ell_\infty$-approachability depend on the dimension of the space of the vectorial payoffs, which is often prohibitively large. Thus, we present a framework for converting high-dimensional $\ell_\infty$-approachability problems to low-dimensional pseudonorm approachability problems, thereby resolving such issues. We first show that the $\ell_\infty$-distance between the average payoff and the approachability set can be equivalently defined as a pseudodistance between a lower-dimensional average vector payoff and a new convex set we define. Next, we develop an algorithmic theory of pseudonorm approachability, analogous to previous work on approachability for $\ell_2$ and other norms, showing that it can be achieved via online linear optimization (OLO) over a convex set given by the Fenchel dual of the unit pseudonorm ball. We then use that to show, modulo mild normalization assumptions, that there exists an $\ell_\infty$-approachability algorithm whose convergence is independent of the dimension of the original vectorial payoff. We further show that that algorithm admits a polynomial-time complexity, assuming that the original $\ell_\infty$-distance can be computed efficiently. We also give an $\ell_\infty$-approachability algorithm whose convergence is logarithmic in that dimension using an FTRL algorithm with a maximum-entropy regularizer.


title: LSA-PINN: Linear Boundary Connectivity Loss for Solving PDEs on Complex Geometry

abstract: We present a novel loss formulation for efficient learning of complex dynamics from governing physics, typically described by partial differential equations (PDEs), using physics-informed neural networks (PINNs). In our experiments, existing versions of PINNs are seen to learn poorly in many problems, especially for complex geometries, as it becomes increasingly difficult to establish appropriate sampling strategy at the near boundary region. Overly dense sampling can adversely impede training convergence if the local gradient behaviors are too complex to be adequately modelled by PINNs. On the other hand, if the samples are too sparse, existing PINNs tend to overfit the near boundary region, leading to incorrect solution. To prevent such issues, we propose a new Boundary Connectivity (BCXN) loss function which provides linear local structure approximation (LSA) to the gradient behaviors at the boundary for PINN. Our BCXN-loss implicitly imposes local structure during training, thus facilitating fast physics-informed learning across entire problem domains with order of magnitude sparser training samples. This LSA-PINN method shows a few orders of magnitude smaller errors than existing methods in terms of the standard L2-norm metric, while using dramatically fewer training samples and iterations. Our proposed LSA-PINN does not pose any requirement on the differentiable property of the networks, and we demonstrate its benefits and ease of implementation on both multi-layer perceptron and convolutional neural network versions as commonly used in current PINN literature.


title: Model theory of probability spaces

abstract: This expository paper treats the model theory of probability spaces using the framework of continuous $[0,1]$-valued first order logic. The metric structures discussed, which we call probability algebras, are obtained from probability spaces by identifying two measurable sets if they differ by a set of measure zero. The class of probability algebras is axiomatizable in continuous first order logic; we denote its theory by $Pr$. We show that the existentially closed structures in this class are exactly the ones in which the underlying probability space is atomless. This subclass is also axiomatizable; its theory $APA$ is the model companion of $Pr$. We show that $APA$ is separably categorical (hence complete), has quantifier elimination, is $\omega$-stable, and has built-in canonical bases, and we give a natural characterization of its independence relation. For general probability algebras, we prove that the set of atoms (enlarged by adding $0$) is a definable set, uniformly in models of $Pr$. We use this fact as a basis for giving a complete treatment of the model theory of arbitrary probability spaces. The core of this paper is an extensive presentation of the main model theoretic properties of $APA$. We discuss Maharam's structure theorem for probability algebras, and indicate the close connections between the ideas behind it and model theory. We show how probabilistic entropy provides a rank connected to model theoretic forking in probability algebras. In the final section we mention some open problems.


title: Multiple Thinking Achieving Meta-Ability Decoupling for Object Navigation

abstract: We propose a meta-ability decoupling (MAD) paradigm, which brings together various object navigation methods in an architecture system, allowing them to mutually enhance each other and evolve together. Based on the MAD paradigm, we design a multiple thinking (MT) model that leverages distinct thinking to abstract various meta-abilities. Our method decouples meta-abilities from three aspects: input, encoding, and reward while employing the multiple thinking collaboration (MTC) module to promote mutual cooperation between thinking. MAD introduces a novel qualitative and quantitative interpretability system for object navigation. Through extensive experiments on AI2-Thor and RoboTHOR, we demonstrate that our method outperforms state-of-the-art (SOTA) methods on both typical and zero-shot object navigation tasks.


title: Primitive almost simple IBIS groups with sporadic socle

abstract: An irredundant base $B$ for a permutation group $G\leq \mathrm{Sym}(\Omega)$ is an ordered subset of $\Omega$ with trivial stabiliser such that no base point is fixed by the stabiliser of its predecessors. Groups whose irredundant bases all have the same size are termed Irredundant Bases of Invariant Size (IBIS) groups, and were introduced by Cameron and Fon-Der-Flaass. In this paper, we contribute to the classification of primitive IBIS groups by classifying those that are almost simple with sporadic socle.


title: Improving Recommendation Relevance by simulating User Interest

abstract: Most if not all on-line item-to-item recommendation systems rely on estimation of a distance like measure (rank) of similarity between items. For on-line recommendation systems, time sensitivity of this similarity measure is extremely important. We observe that recommendation "recency" can be straightforwardly and transparently maintained by iterative reduction of ranks of inactive items. The paper briefly summarizes algorithmic developments based on this self-explanatory observation. The basic idea behind this work is patented in a context of online recommendation systems.


title: Multi-channel Autobidding with Budget and ROI Constraints

abstract: In digital online advertising, advertisers procure ad impressions simultaneously on multiple platforms, or so-called channels, such as Google Ads, Meta Ads Manager, etc., each of which consists of numerous ad auctions. We study how an advertiser maximizes total conversion (e.g. ad clicks) while satisfying aggregate return-on-investment (ROI) and budget constraints across all channels. In practice, an advertiser does not have control over, and thus cannot globally optimize, which individual ad auctions she participates in for each channel, and instead authorizes a channel to procure impressions on her behalf: the advertiser can only utilize two levers on each channel, namely setting a per-channel budget and per-channel target ROI. In this work, we first analyze the effectiveness of each of these levers for solving the advertiser's global multi-channel problem. We show that when an advertiser only optimizes over per-channel ROIs, her total conversion can be arbitrarily worse than what she could have obtained in the global problem. Further, we show that the advertiser can achieve the global optimal conversion when she only optimizes over per-channel budgets. In light of this finding, under a bandit feedback setting that mimics real-world scenarios where advertisers have limited information on ad auctions in each channels and how channels procure ads, we present an efficient learning algorithm that produces per-channel budgets whose resulting conversion approximates that of the global optimal problem. Finally, we argue that all our results hold for both single-item and multi-item auctions from which channels procure impressions on advertisers' behalf.


title: Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothing

abstract: Most graph neural networks follow the message passing mechanism. However, it faces the over-smoothing problem when multiple times of message passing is applied to a graph, causing indistinguishable node representations and prevents the model to effectively learn dependencies between farther-away nodes. On the other hand, features of neighboring nodes with different labels are likely to be falsely mixed, resulting in the heterophily problem. In this work, we propose to order the messages passing into the node representation, with specific blocks of neurons targeted for message passing within specific hops. This is achieved by aligning the hierarchy of the rooted-tree of a central node with the ordered neurons in its node representation. Experimental results on an extensive set of datasets show that our model can simultaneously achieve the state-of-the-art in both homophily and heterophily settings, without any targeted design. Moreover, its performance maintains pretty well while the model becomes really deep, effectively preventing the over-smoothing problem. Finally, visualizing the gating vectors shows that our model learns to behave differently between homophily and heterophily settings, providing an explainable graph neural model.


title: Tuning the Interlayer Microstructure and Residual Stress of Buffer-Free Direct Bonding GaN/Si Heterostructures

abstract: The direct integration of GaN with Si can boost great potential for low-cost, large-scale, and high-power device applications. However, it is still challengeable to directly grow GaN on Si without using thick strain relief buffer layers due to their large lattice and thermal-expansion-coefficient mismatches. In this work, a GaN/Si heterointerface without any buffer layer is successfully fabricated at room temperature via surface activated bonding (SAB). The residual stress states and interfacial microstructures of GaN/Si heterostructures were systematically investigated through micro-Raman spectroscopy and transmission electron microscopy. Compared to the large compressive stress that existed in GaN layers grown-on-Si by MOCVD, a significantly relaxed and uniform small tensile stress was observed in GaN layers bonded-to-Si by SAB; this is mainly ascribed to the amorphous layer formed at the bonding interface. In addition, the interfacial microstructure and stress states of bonded GaN/Si heterointerfaces was found can be significantly tuned by appropriate thermal annealing. This work moves an important step forward directly integrating GaN to the present Si CMOS technology with high quality thin interfaces, and brings great promises for wafer-scale low-cost fabrication of GaN electronics.


title: Example-Based Explainable AI and its Application for Remote Sensing Image Classification

abstract: We present a method of explainable artificial intelligence (XAI), "What I Know (WIK)", to provide additional information to verify the reliability of a deep learning model by showing an example of an instance in a training dataset that is similar to the input data to be inferred and demonstrate it in a remote sensing image classification task. One of the expected roles of XAI methods is verifying whether inferences of a trained machine learning model are valid for an application, and it is an important factor that what datasets are used for training the model as well as the model architecture. Our data-centric approach can help determine whether the training dataset is sufficient for each inference by checking the selected example data. If the selected example looks similar to the input data, we can confirm that the model was not trained on a dataset with a feature distribution far from the feature of the input data. With this method, the criteria for selecting an example are not merely data similarity with the input data but also data similarity in the context of the model task. Using a remote sensing image dataset from the Sentinel-2 satellite, the concept was successfully demonstrated with reasonably selected examples. This method can be applied to various machine-learning tasks, including classification and regression.


title: Quantum Data-Syndrome Codes: Subsystem and Impure Code Constructions

abstract: Quantum error correction requires the use of error syndromes derived from measurements that may be unreliable. Recently, quantum data-syndrome (QDS) codes have been proposed as a possible approach to protect against both data and syndrome errors, in which a set of linearly dependent stabilizer measurements are performed to increase redundancy. Motivated by wanting to reduce the total number of measurements performed, we introduce QDS subsystem codes, and show that they can outperform similar QDS stabilizer codes derived from them. We also give a construction of single-error-correcting QDS stabilizer codes from impure stabilizer codes, and show that any such code must satisfy a variant of the quantum Hamming bound for QDS codes. Finally, we use this bound to prove a new bound that applies to impure, but not pure, stabilizer codes that may be of independent interest.


title: Four principles for improved statistical ecology

abstract: Increasing attention has been drawn to the misuse of statistical methods over recent years, with particular concern about the prevalence of practices such as poor experimental design, cherry-picking and inadequate reporting. These failures are largely unintentional and no more common in ecology than in other scientific disciplines, with many of them easily remedied given the right guidance. Originating from a discussion at the 2020 International Statistical Ecology Conference, we show how ecologists can build their research following four guiding principles for impactful statistical research practices: 1. Define a focused research question, then plan sampling and analysis to answer it; 2. Develop a model that accounts for the distribution and dependence of your data; 3. Emphasise effect sizes to replace statistical significance with ecological relevance; 4. Report your methods and findings in sufficient detail so that your research is valid and reproducible. Listed in approximate order of importance, these principles provide a framework for experimental design and reporting that guards against unsound practices. Starting with a well-defined research question allows researchers to create an efficient study to answer it, and guards against poor research practices that lead to false positives and poor replicability. Correct and appropriate statistical models give sound conclusions, good reporting practices and a focus on ecological relevance make results impactful and replicable. Illustrated with an example from a recent study into the impact of disturbance on upland swamps, this paper explains the rationale for the selection and use of effective statistical practices and provides practical guidance for ecologists seeking to improve their use of statistical methods.


title: Failure-informed adaptive sampling for PINNs, Part II: combining with re-sampling and subset simulation

abstract: This is the second part of our series works on failure-informed adaptive sampling for physic-informed neural networks (FI-PINNs). In our previous work \cite{gao2022failure}, we have presented an adaptive sampling framework by using the failure probability as the posterior error indicator, where the truncated Gaussian model has been adopted for estimating the indicator. In this work, we present two novel extensions to FI-PINNs. The first extension consist in combining with a re-sampling technique, so that the new algorithm can maintain a constant training size. This is achieved through a cosine-annealing, which gradually transforms the sampling of collocation points from uniform to adaptive via training progress. The second extension is to present the subset simulation algorithm as the posterior model (instead of the truncated Gaussian model) for estimating the error indicator, which can more effectively estimate the failure probability and generate new effective training points in the failure region. We investigate the performance of the new approach using several challenging problems, and numerical experiments demonstrate a significant improvement over the original algorithm.


title: Revisiting Intermediate Layer Distillation for Compressing Language Models: An Overfitting Perspective

abstract: Knowledge distillation (KD) is a highly promising method for mitigating the computational problems of pre-trained language models (PLMs). Among various KD approaches, Intermediate Layer Distillation (ILD) has been a de facto standard KD method with its performance efficacy in the NLP field. In this paper, we find that existing ILD methods are prone to overfitting to training datasets, although these methods transfer more information than the original KD. Next, we present the simple observations to mitigate the overfitting of ILD: distilling only the last Transformer layer and conducting ILD on supplementary tasks. Based on our two findings, we propose a simple yet effective consistency-regularized ILD (CR-ILD), which prevents the student model from overfitting the training dataset. Substantial experiments on distilling BERT on the GLUE benchmark and several synthetic datasets demonstrate that our proposed ILD method outperforms other KD techniques. Our code is available at https://github.com/jongwooko/CR-ILD.


title: Universal multi-stream radial structures of cold dark matter halos

abstract: Virialized halos of cold dark matter generically exhibit multi-stream structures of accreted dark matter within an outermost radial caustic known as the splashback radius. By tracking the particle trajectories that accrete onto the halos in cosmological $N$-body simulations, we count their number of apocenter passages ($p$), and use them to characterize the multi-stream structure of dark matter particles. We find that the radial density profile for each stream, classified by the number of apocenter passages, exhibits universal features, and can be described by a double power-law function comprising inner shallow and outer steep slopes of indices of $-1$ and $-8$, respectively. Surprisingly, these properties hold over a wide range of halo masses. The double-power law feature is persistent when dividing the sample by concentration or accretion rate. The dependence of the characteristic scale and amplitude of the profile on $p$ cannot be replicated by known self-similar solutions, requiring consideration of complexities such as the distribution of angular momentum or mergers.


title: INV: Towards Streaming Incremental Neural Videos

abstract: Recent works in spatiotemporal radiance fields can produce photorealistic free-viewpoint videos. However, they are inherently unsuitable for interactive streaming scenarios (e.g. video conferencing, telepresence) because have an inevitable lag even if the training is instantaneous. This is because these approaches consume videos and thus have to buffer chunks of frames (often seconds) before processing. In this work, we take a step towards interactive streaming via a frame-by-frame approach naturally free of lag. Conventional wisdom believes that per-frame NeRFs are impractical due to prohibitive training costs and storage. We break this belief by introducing Incremental Neural Videos (INV), a per-frame NeRF that is efficiently trained and streamable. We designed INV based on two insights: (1) Our main finding is that MLPs naturally partition themselves into Structure and Color Layers, which store structural and color/texture information respectively. (2) We leverage this property to retain and improve upon knowledge from previous frames, thus amortizing training across frames and reducing redundant learning. As a result, with negligible changes to NeRF, INV can achieve good qualities (>28.6db) in 8min/frame. It can also outperform prior SOTA in 19% less training time. Additionally, our Temporal Weight Compression reduces the per-frame size to 0.3MB/frame (6.6% of NeRF). More importantly, INV is free from buffer lag and is naturally fit for streaming. While this work does not achieve real-time training, it shows that incremental approaches like INV present new possibilities in interactive 3D streaming. Moreover, our discovery of natural information partition leads to a better understanding and manipulation of MLPs. Code and dataset will be released soon.


title: Dependence of ocean surface filaments on wind speed: An observational study of North Atlantic right whale habitat

abstract: Coherent filaments at the ocean surface often appear to be transient watermass boundaries, where currents converge, surfactants accumulate, and frontal structure at depth can possibly delineate enhanced biological activity in the upper water column. Spaceborne synthetic aperture radar (SAR) permits filaments to be observed at O[1-km] resolution, but extensive coherent structures are more apparent in weaker winds. A wind speed adjustment is proposed for filaments (i.e., contiguous SAR contrasts) of at least 10 km in length. Measures of dependence (distance correlation and the linear and nonlinear components of Pearson correlation) are examined to identify a broad peak in the relationship between filament contrast and weak or moderate values of surface wind speed, where a variable wind speed exponent is employed to maximize these measures. Three locations of recent North Atlantic right whale (Eubalaena glacialis) sightings in the Gulf of St. Lawrence are sampled between 2008 and 2020 by 324 Radarsat-2 SAR scenes and 10-m wind speed from the ERA5 reanalysis. The inverse relationship between SAR contrast magnitude and wind speed is quantified, and a reduced correlation is obtained for all three domains when SAR contrast is weighted by wind speed to the power of 0.8. A more uniform emphasis on ocean surface structure within a SAR scene, or across multiple scenes, can thus be considered in the search for prey aggregations of the North Atlantic right whale.


title: Optimized time-lapse acquisition design via spectral gap ratio minimization

abstract: Modern-day reservoir management and monitoring of geological carbon storage increasingly call for costly time-lapse seismic data collection. In this letter, we show how techniques from graph theory can be used to optimize acquisition geometries for low-cost sparse 4D seismic. Based on midpoint-offset domain connectivity arguments, the proposed algorithm automatically produces sparse non-replicated time-lapse acquisition geometries that favor wavefield recovery.


title: Support Recovery in Sparse PCA with Non-Random Missing Data

abstract: We analyze a practical algorithm for sparse PCA on incomplete and noisy data under a general non-random sampling scheme. The algorithm is based on a semidefinite relaxation of the $\ell_1$-regularized PCA problem. We provide theoretical justification that under certain conditions, we can recover the support of the sparse leading eigenvector with high probability by obtaining a unique solution. The conditions involve the spectral gap between the largest and second-largest eigenvalues of the true data matrix, the magnitude of the noise, and the structural properties of the observed entries. The concepts of algebraic connectivity and irregularity are used to describe the structural properties of the observed entries. We empirically justify our theorem with synthetic and real data analysis. We also show that our algorithm outperforms several other sparse PCA approaches especially when the observed entries have good structural properties. As a by-product of our analysis, we provide two theorems to handle a deterministic sampling scheme, which can be applied to other matrix-related problems.


title: Using natural language processing and structured medical data to phenotype patients hospitalized due to COVID-19

abstract: To identify patients who are hospitalized because of COVID-19 as opposed to those who were admitted for other indications, we compared the performance of different computable phenotype definitions for COVID-19 hospitalizations that use different types of data from the electronic health records (EHR), including structured EHR data elements, provider notes, or a combination of both data types. And conduct a retrospective data analysis utilizing chart review-based validation. Participants are 586 hospitalized individuals who tested positive for SARS-CoV-2 during January 2022. We used natural language processing to incorporate data from provider notes and LASSO regression and Random Forests to fit classification algorithms that incorporated structured EHR data elements, provider notes, or a combination of structured data and provider notes. Results: Based on a chart review, 38% of 586 patients were determined to be hospitalized for reasons other than COVID-19 despite having tested positive for SARS-CoV-2. A classification algorithm that used provider notes had significantly better discrimination than one that used structured EHR data elements (AUROC: 0.894 vs 0.841, p < 0.001), and performed similarly to a model that combined provider notes with structured data elements (AUROC: 0.894 vs 0.893). Assessments of hospital outcome metrics significantly differed based on whether the population included all hospitalized patients who tested positive for SARS-CoV-2 versus those who were determined to have been hospitalized due to COVID-19. This work demonstrates the utility of natural language processing approaches to derive information related to patient hospitalizations in cases where there may be multiple conditions that could serve as the primary indication for hospitalization.


title: Gradient and Variable Tracking with Multiple Local SGD for Decentralized Non-Convex Learning

abstract: Stochastic distributed optimization methods that solve an optimization problem over a multi-agent network have played an important role in a variety of large-scale signal processing and machine leaning applications. Among the existing methods, the gradient tracking (GT) method is found robust against the variance between agents' local data distribution, in contrast to the distributed stochastic gradient descent (SGD) methods which have a slowed convergence speed when the agents have heterogeneous data distributions. However, the GT method can be communication expensive due to the need of a large number of iterations for convergence. In this paper, we intend to reduce the communication cost of the GT method by integrating it with the local SGD technique. Specifically, we propose a new local stochastic GT (LSGT) algorithm where, within each communication round, the agents perform multiple SGD updates locally. Theoretically, we build the convergence conditions of the LSGT algorithm and show that it can have an improved convergence rate of $\mathcal{O}(1/\sqrt{ET})$, where $E$ is the number of local SGD updates and $T$ is the number of communication rounds. We further extend the LSGT algorithm to solve a more complex learning problem which has linearly coupled variables inside the objective function. Experiment results demonstrate that the proposed algorithms have significantly improved convergence speed even under heterogeneous data distribution.


title: DCEM-PINNs: A deep complementary energy method for solid mechanics

abstract: In recent years, the rapid advancement of deep learning has significantly impacted various fields, particularly in solving partial differential equations (PDEs) in the realm of solid mechanics, benefiting greatly from the remarkable approximation capabilities of neural networks. In solving PDEs, Physics-Informed Neural Networks (PINNs) and the Deep Energy Method (DEM) have garnered substantial attention. The principle of minimum potential energy and complementary energy are two important variational principles in solid mechanics. However, the well-known Deep Energy Method (DEM) is based on the principle of minimum potential energy, but there lacks the important form of minimum complementary energy. To bridge this gap, we propose the deep complementary energy method (DCEM) based on the principle of minimum complementary energy. The output function of DCEM is the stress function, which inherently satisfies the equilibrium equation. We present numerical results using the Prandtl and Airy stress functions, and compare DCEM with existing PINNs and DEM algorithms when modeling representative mechanical problems. The results demonstrate that DCEM outperforms DEM in terms of stress accuracy and efficiency and has an advantage in dealing with complex displacement boundary conditions, which is supported by theoretical analyses and numerical simulations. We extend DCEM to DCEM-Plus (DCEM-P), adding terms that satisfy partial differential equations. Furthermore, we propose a deep complementary energy operator method (DCEM-O) by combining operator learning with physical equations. Initially, we train DCEM-O using high-fidelity numerical results and then incorporate complementary energy. DCEM-P and DCEM-O further enhance the accuracy and efficiency of DCEM.


title: A Lipschitz Bandits Approach for Continuous Hyperparameter Optimization

abstract: One of the most critical problems in machine learning is HyperParameter Optimization (HPO), since choice of hyperparameters has a significant impact on final model performance. Although there are many HPO algorithms, they either have no theoretical guarantees or require strong assumptions. To this end, we introduce BLiE -- a Lipschitz-bandit-based algorithm for HPO that only assumes Lipschitz continuity of the objective function. BLiE exploits the landscape of the objective function to adaptively search over the hyperparameter space. Theoretically, we show that $(i)$ BLiE finds an $\epsilon$-optimal hyperparameter with $\mathcal{O} \left( \epsilon^{-(d_z + \beta)}\right)$ total budgets, where $d_z$ and $\beta$ are problem intrinsic; $(ii)$ BLiE is highly parallelizable. Empirically, we demonstrate that BLiE outperforms the state-of-the-art HPO algorithms on benchmark tasks. We also apply BLiE to search for noise schedule of diffusion models. Comparison with the default schedule shows that BLiE schedule greatly improves the sampling speed.


title: DEVICE: DEpth and VIsual ConcEpts Aware Transformer for TextCaps

abstract: Text-based image captioning is an important but under-explored task, aiming to generate descriptions containing visual objects and scene text. Recent studies have made encouraging progress, but they are still suffering from a lack of overall understanding of scenes and generating inaccurate captions. One possible reason is that current studies mainly focus on constructing the plane-level geometric relationship of scene text without depth information. This leads to insufficient scene text relational reasoning so that models may describe scene text inaccurately. The other possible reason is that existing methods fail to generate fine-grained descriptions of some visual objects. In addition, they may ignore essential visual objects, leading to the scene text belonging to these ignored objects not being utilized. To address the above issues, we propose a DEpth and VIsual ConcEpts Aware Transformer (DEVICE) for TextCaps. Concretely, to construct three-dimensional geometric relations, we introduce depth information and propose a depth-enhanced feature updating module to ameliorate OCR token features. To generate more precise and comprehensive captions, we introduce semantic features of detected visual object concepts as auxiliary information. Our DEVICE is capable of generalizing scenes more comprehensively and boosting the accuracy of described visual entities. Sufficient experiments demonstrate the effectiveness of our proposed DEVICE, which outperforms state-of-the-art models on the TextCaps test set. Our code will be publicly available.


abstract: Contrastive learning demonstrates great promise for representation learning. Data augmentations play a critical role in contrastive learning by providing informative views of the data without needing the labels. However, the performance of the existing works heavily relies on the quality of the employed data augmentation (DA) functions, which are typically hand picked from a restricted set of choices. While exploiting a diverse set of data augmentations is appealing, the intricacies of DAs and representation learning may lead to performance degradation. To address this challenge and allow for a systemic use of large numbers of data augmentations, this paper proposes Contrastive Learning with Consistent Representations (CoCor). At the core of CoCor is a new consistency measure, DA consistency, which dictates the mapping of augmented input data to the representation space such that these instances are mapped to optimal locations in a way consistent to the intensity of the DA applied. Furthermore, a data-driven approach is proposed to learn the optimal mapping locations as a function of DA while maintaining a desired monotonic property with respect to DA intensity. The proposed techniques give rise to a semi-supervised learning framework based on bi-level optimization, achieving new state-of-the-art results for image recognition.


title: Lateralization in Agents' Decision Making: Evidence of Benefits/Costs from Artificial Intelligence

abstract: Lateralization is ubiquitous in vertebrate brains which, as well as its role in locomotion, is considered an important factor in biological intelligence. Lateralization has been associated with both poor and good performance. It has been hypothesized that lateralization has benefits that may counterbalance its costs. Given that lateralization is ubiquitous, it likely has advantages that can benefit artificial intelligence. In turn, lateralized artificial intelligent systems can be used as tools to advance the understanding of lateralization in biological intelligence. Recently lateralization has been incorporated into artificially intelligent systems to solve complex problems in computer vision and navigation domains. Here we describe and test two novel lateralized artificial intelligent systems that simultaneously represent and address given problems at constituent and holistic levels. The experimental results demonstrate that the lateralized systems outperformed state-of-the-art non-lateralized systems in resolving complex problems. The advantages arise from the abilities, (i) to represent an input signal at both the constituent level and holistic level simultaneously, such that the most appropriate viewpoint controls the system; (ii) to avoid extraneous computations by generating excite and inhibit signals. The computational costs associated with the lateralized AI systems are either less than the conventional AI systems or countered by providing better solutions.


title: Multiplier Bootstrap-based Exploration

abstract: Despite the great interest in the bandit problem, designing efficient algorithms for complex models remains challenging, as there is typically no analytical way to quantify uncertainty. In this paper, we propose Multiplier Bootstrap-based Exploration (MBE), a novel exploration strategy that is applicable to any reward model amenable to weighted loss minimization. We prove both instance-dependent and instance-independent rate-optimal regret bounds for MBE in sub-Gaussian multi-armed bandits. With extensive simulation and real data experiments, we show the generality and adaptivity of MBE.


title: Optimality of Thompson Sampling with Noninformative Priors for Pareto Bandits

abstract: In the stochastic multi-armed bandit problem, a randomized probability matching policy called Thompson sampling (TS) has shown excellent performance in various reward models. In addition to the empirical performance, TS has been shown to achieve asymptotic problem-dependent lower bounds in several models. However, its optimality has been mainly addressed under light-tailed or one-parameter models that belong to exponential families. In this paper, we consider the optimality of TS for the Pareto model that has a heavy tail and is parameterized by two unknown parameters. Specifically, we discuss the optimality of TS with probability matching priors that include the Jeffreys prior and the reference priors. We first prove that TS with certain probability matching priors can achieve the optimal regret bound. Then, we show the suboptimality of TS with other priors, including the Jeffreys and the reference priors. Nevertheless, we find that TS with the Jeffreys and reference priors can achieve the asymptotic lower bound if one uses a truncation procedure. These results suggest carefully choosing noninformative priors to avoid suboptimality and show the effectiveness of truncation procedures in TS-based policies.


title: Ligand hole driven metal-insulator transition in a prototypical transition metal double perovskite oxide Ca$_2$FeMnO$_6$

abstract: Ca$_2$FeMnO$_6$ (CFMO) double perovskite was studied using first principles density functional theory and tight-binding (TB) Hamiltonian modeling using extended Hubbard model. We have shown by electronic structure analysis that charge- and magnetic-ordering are driven by charge disproportionation at low temperature caused by partial localization of O-$2p$ ligand holes at alternate Fe sites that creates Jahn-Teller distortion, which leads to metal to insulator transition (MIT) in CFMO. Our results suggests MIT was triggered by negative charge-transfer energy of self-hole doping, responsible for symmetry lowering transitions. Notably, the band-gap was found to fundamentally controlled by the strength of the charge-transfer energy, and not by the Mott-Hubbard interactions, which can be modeled by composition, pressure or stoichiometry modulations. The fundamental insights presented in this work will help understand similar physics and mechanisms in other class of perovskites and correlated metals.


title: Group Fairness in Non-monotone Submodular Maximization

abstract: Maximizing a submodular function has a wide range of applications in machine learning and data mining. One such application is data summarization whose goal is to select a small set of representative and diverse data items from a large dataset. However, data items might have sensitive attributes such as race or gender, in this setting, it is important to design \emph{fairness-aware} algorithms to mitigate potential algorithmic bias that may cause over- or under- representation of particular groups. Motivated by that, we propose and study the classic non-monotone submodular maximization problem subject to novel group fairness constraints. Our goal is to select a set of items that maximizes a non-monotone submodular function, while ensuring that the number of selected items from each group is proportionate to its size, to the extent specified by the decision maker. We develop the first constant-factor approximation algorithms for this problem. We also extend the basic model to incorporate an additional global size constraint on the total number of selected items.


title: Evidence to disfavour dual core system leading to double-peaked narrow emission lines

abstract: In this manuscript, an interesting method is proposed to test dual core system for double-peaked narrow emission lines, through precious dual core system with double-peaked narrow Balmer lines in one system in main galaxy but with single-peaked narrow Balmer lines in the other system in companion galaxy. Under a dual core system, considering narrow Balmer (H$\alpha$ and H$\beta$) emissions ($f_{e,~\alpha}$ and $f_{e,~\beta}$) from companion galaxy but covered by SDSS fiber for the main galaxy and narrow Balmer emissions ($f_{c,~\alpha}$ and $f_{c,~\beta}$) from the companion galaxy covered by SDSS fiber for the companion galaxy, the same flux ratios $f_{e,~\alpha}/f_{c,~\alpha}=f_{e,~\beta}/f_{c,~\beta}$ can be expected, due to totally similar physical conditions of each narrow Balmer emission region. Then, the precious dual core system in SDSS J2219-0938 is discussed. After subtracting pPXF code determined stellar lights, double-peaked narrow Balmer emission lines are confirmed in the main galaxy with confidence level higher than $5\sigma$, but single-peaked narrow Balmer emission lines in the companion galaxy. Through measured fluxes of emission components, $f_{e,~\alpha}/f_{c,~\alpha}$ is around 0.82, different from $f_{e,~\beta}/f_{c,~\beta}\sim0.52$, to disfavour a dual core system for the double-peaked narrow Balmer emission lines in SDSS J2219-0938.


title: An FPGA-based readout chip emulator for the CMS ETL detector upgrade

abstract: We present an FPGA-based readout chip emulator board for the CMS Endcap Timing Layer (ETL) detector upgrade. The emulator board uses an Intel Cyclone 10 GX FPGA to emulate the digital functions of four Endcap Layer Readout Chips (ETROCs). Based on the actual ETROC design, the firmware is implemented and verified. The emulator board is being used for the ETROC digital design verification and system development.


title: Coexistence of ferromagnetism and superconductivity at KTaO$_3$ heterointerfaces

abstract: The coexistence of superconductivity and ferromagnetism is a long-standing issue in superconductivity due to the antagonistic nature of these two ordered states. Experimentally identifying and characterizing novel heterointerface superconductors that coexist with magnetism presents significant challenges. Here, we report the experimental observation of two-dimensional long-range ferromagnetic order in the KTaO$_3$ heterointerface superconductor, showing the coexistence of superconductivity and ferromagnetism. Remarkably, our direct current superconducting quantum interference device measurements reveal an in-plane magnetization hysteresis loop persisting above room temperature. Moreover, the first-principles calculations and X-ray magnetic circular dichroism measurements provide decisive insights into the origin of the observed robust ferromagnetism, attributing it to oxygen vacancies that localize electrons in nearby Ta 5$d$ states. Our findings not only suggest KTaO$_3$ heterointerfaces as time-reversal symmetry breaking superconductors, but also inject fresh momentum into the exploration of the intricate interplay between superconductivity and magnetism, enhanced by the strong spin-orbit coupling inherent to the heavy Ta in 5$d$ orbitals of KTaO$_3$ heterointerfaces.


title: Vertical Federated Learning: Taxonomies, Threats, and Prospects

abstract: Federated learning (FL) is the most popular distributed machine learning technique. FL allows machine-learning models to be trained without acquiring raw data to a single point for processing. Instead, local models are trained with local data; the models are then shared and combined. This approach preserves data privacy as locally trained models are shared instead of the raw data themselves. Broadly, FL can be divided into horizontal federated learning (HFL) and vertical federated learning (VFL). For the former, different parties hold different samples over the same set of features; for the latter, different parties hold different feature data belonging to the same set of samples. In a number of practical scenarios, VFL is more relevant than HFL as different companies (e.g., bank and retailer) hold different features (e.g., credit history and shopping history) for the same set of customers. Although VFL is an emerging area of research, it is not well-established compared to HFL. Besides, VFL-related studies are dispersed, and their connections are not intuitive. Thus, this survey aims to bring these VFL-related studies to one place. Firstly, we classify existing VFL structures and algorithms. Secondly, we present the threats from security and privacy perspectives to VFL. Thirdly, for the benefit of future researchers, we discussed the challenges and prospects of VFL in detail.


title: Fundamental solutions of an extended hydrodynamic model in two dimensions: Derivation, theory, and applications

abstract: The inability of the Navier-Stokes-Fourier equations to capture rarefaction effects motivates us to adopt the extended hydrodynamic equations. In the present work, a hydrodynamic model, which consists of the conservation laws closed with the recently propounded coupled constitutive relations (CCR), is utilized. This model is referred to as the CCR model and is adequate for describing moderately rarefied gas flows. A numerical framework based on the method of fundamental solutions is developed to solve the CCR model for rarefied gas flow problems in quasi two dimensions. To this end, the fundamental solutions of the linearized CCR model are derived in two dimensions. The significance of deriving the two-dimensional fundamental solutions is that they cannot be deduced from their three-dimensional counterparts that do exist in literature. As applications, the developed numerical framework based on the derived fundamental solutions is used to simulate (i) a rarefied gas flow between two coaxial cylinders with evaporating walls and (ii) a temperature-driven rarefied gas flow between two non-coaxial cylinders. The results for both problems have been validated against those obtained with the other classical approaches. Through this, it is shown that the method of fundamental solutions is an efficient tool for addressing quasi two-dimensional multiphase microscale gas flow problems at a low computational cost. Moreover, the findings also show that the CCR model solved with the method of fundamental solutions is able to describe rarefaction effects, like transpiration flows and thermal stress, generally well.


title: Self-similar quantum groups

abstract: We introduce the notion of self-similarity for compact quantum groups. For a finite set $X$, we introduce a $C^*$-algebra $\mathbb{A}_X$, which is the quantum automorphism group of the infinite homogeneous rooted tree $X^*$. Self-similar quantum groups are then certain quantum subgroups of $\mathbb{A}_X$. Our main class of examples are called finitely-constrained self-similar quantum groups, and we find a class of these examples that can be described as quantum wreath products by subgroups of the quantum permutation group.


title: Efficient control pulses for continuous quantum gate families through coordinated re-optimization

abstract: We present a general method to quickly generate high-fidelity control pulses for any continuously-parameterized set of quantum gates after calibrating a small number of reference pulses. We find that interpolating between optimized control pulses for different quantum operations does not immediately yield a high-fidelity intermediate operation. To solve this problem, we propose a method to optimize control pulses specifically to provide good interpolations. We pick several reference operations in the gate family of interest and optimize pulses that implement these operations, then iteratively re-optimize the pulses to guide their shapes to be similar for operations that are closely related. Once this set of reference pulses is calibrated, we can use a straightforward linear interpolation method to instantly obtain high-fidelity pulses for arbitrary gates in the continuous operation space. We demonstrate this procedure on the three-parameter Cartan decomposition of two-qubit gates to obtain control pulses for any arbitrary two-qubit gate (up to single-qubit operations) with consistently high fidelity. Compared to previous neural network approaches, the method is 7.7x more computationally efficient to calibrate the pulse space for the set of all single-qubit gates. Our technique generalizes to any number of gate parameters and could easily be used with advanced pulse optimization algorithms to allow for better translation from simulation to experiment.


title: Emergence of cosmic space with Barrow entropy, in non-equilibrium thermodynamic conditions

abstract: Recently, Barrow accounts for the quantum gravitational effects to the black hole surface. Thus the conventional area-entropy relation has modified, $S=(A/A_{0})^{1+\Delta/2},$ with an exponent $\Delta$, ranges $0\le\Delta\le1$, quantifies the amount of quantum gravitational deformation effect to the black hole surface. In recent literature, this horizon entropy has been extended to the cosmological context. Following this, we consider an n+1 dimensional non-flat universe with an apparent horizon as the boundary with appropriate temperature and associated entropy is Barrow entropy. We derived the modified form of the law of emergence from the equilibrium and non-equilibrium thermodynamic principles. Later studied the entropy maximization condition due to the modified law of emergence. On distinguishing the obtained result, it speculates that in order to hold the energy-momentum conservation, the universe with Barrow entropy as the horizon entropy should have non-equilibrium behaviour with an additional entropy production. However, the additional entropy production rate decreases over time, so the system eventually approaches equilibrium. Because of this, the constraint relation for entropy maximization looks similar for both equilibrium and non-equilibrium approaches.


title: Bridging the Emotional Semantic Gap via Multimodal Relevance Estimation

abstract: Human beings have rich ways of emotional expressions, including facial action, voice, and natural languages. Due to the diversity and complexity of different individuals, the emotions expressed by various modalities may be semantically irrelevant. Directly fusing information from different modalities may inevitably make the model subject to the noise from semantically irrelevant modalities. To tackle this problem, we propose a multimodal relevance estimation network to capture the relevant semantics among modalities in multimodal emotions. Specifically, we take advantage of an attention mechanism to reflect the semantic relevance weights of each modality. Moreover, we propose a relevant semantic estimation loss to weakly supervise the semantics of each modality. Furthermore, we make use of contrastive learning to optimize the similarity of category-level modality-relevant semantics across different modalities in feature space, thereby bridging the semantic gap between heterogeneous modalities. In order to better reflect the emotional state in the real interactive scenarios and perform the semantic relevance analysis, we collect a single-label discrete multimodal emotion dataset named SDME, which enables researchers to conduct multimodal semantic relevance research with large category bias. Experiments on continuous and discrete emotion datasets show that our model can effectively capture the relevant semantics, especially for the large deviations in modal semantics. The code and SDME dataset will be publicly available.


title: Machine Learning for UAV Propeller Fault Detection based on a Hybrid Data Generation Model

abstract: This paper describes the development of an on-board data-driven system that can monitor and localize the fault in a quadrotor unmanned aerial vehicle (UAV) and at the same time, evaluate the degree of damage of the fault under real scenarios. To achieve offline training data generation, a hybrid approach is proposed for the development of a virtual data-generative model using a combination of data-driven models as well as well-established dynamic models that describe the kinematics of the UAV. To effectively represent the drop in performance of a faulty propeller, a variation of the deep neural network, a LSTM network is proposed. With the RPM of the propeller as input and based on the fault condition of the propeller, the proposed propeller model estimates the resultant torque and thrust. Then, flight datasets of the UAV under various fault scenarios are generated via simulation using the developed data-generative model. Lastly, a fault classifier using a CNN model is proposed to identify as well as evaluate the degree of damage to the damaged propeller. The scope of this paper focuses on the identification of faulty propellers and classification of the fault level for quadrotor UAVs using RPM as well as flight data. Doing so allows for early minor fault detection to prevent serious faults from occurring if the fault is left unrepaired. To further validate the workability of this approach outside of simulation, a real-flight test is conducted indoors. The real flight data is collected and a simulation to real sim-real test is conducted. Due to the imperfections in the build of our experimental UAV, a slight calibration approach to our simulation model is further proposed and the experimental results obtained show that our trained model can identify the location of propeller fault as well as the degree/type of damage. Currently, the diagnosis accuracy on the testing set is over 80%.


title: Improving the dimension bound of Hermitian Lifted Codes

abstract: In this article we improve the dimension and minimum distance bound of the the Hermitian Lifted Codes LRCs construction from L\'opez, Malmskog, Matthews, Pi\~nero and Wooters (L\'opez et. al.) via elementary univariarte polynomial division. They gave an asymptotic rate estimate of $0.007$. For the case where $q$ is a power of $2$ we improve the rate estimate to $0.010$ using univariate polynomial division.


title: Energy Efficient SDN and SDR Joint Adaptation of CPU Utilization Based on Experimental Data Analytics

abstract: In this paper we propose a hybrid softwarized architecture of Network Function Virtualization (NFV) where Software-Defined Networking (SDN) and Software-Defined Radio (SDR) components are integrated to form a cloud-based communication system. We analyze CPU utilization and power consumption in the OpenIreland testbed for different parameter settings and use case scenarios of this NFV architecture. The experiment results show different behaviour between SDN data plane switching and SDR in terms of CPU utilization and parallelization, which provides insights for processing aggregation and power savings when integrating them together in a cloud-based system. We then propose a power saving scheme with flexible CPU allocation that can reduce the overall power consumption of the system. Our results show that our proposed NFV architecture and its power saving scheme can save up to 20% power consumption compared to conventional scheme where SDN and SDR are separately deployed.


title: The nature of dynamic local order in CH$_3$NH$_3$PbI$_3$ and CH$_3$NH$_3$PbBr$_3$

abstract: Hybrid lead halide perovskites (LHPs) are a class of semiconductor with novel properties that are distinctively governed by structural fluctuations. Diffraction experiments sensitive to average, long-range order reveal a cubic structure in the device-relevant, high-temperature phase. Local probes find additional short-range order with lower symmetry that may govern the structure-function relationships of LHPs. However, the dimensionality, participating atoms, and dynamics of this short-range order are unresolved, impeding our understanding of technologically relevant properties including long carrier lifetimes and facile halide migration. Here, we determine the true structure of two prototypical hybrid LHPs, CH$_3$NH$_3$PbI$_3$ and CH$_3$NH$_3$PbBr$_3$, using a combination of single-crystal X-ray and neutron diffuse scattering, neutron inelastic spectroscopy, and molecular dynamics simulations. The remarkable collective dynamics we found are not suggested by previous studies and consist of a network of local two-dimensional, circular pancake-like regions of dynamically tilting lead halide octahedra (lower symmetry) that induce longer range intermolecular correlations within the CH$_3$NH$_3^+$ sublattice. The dynamic local structure can introduce transient ferroelectric or antiferroelectric domains that increase charge carrier lifetimes, and strongly affect the halide migration, a poorly understood degradation mechanism. Our approach of co-analyzing single-crystal X-ray and neutron diffuse scattering data with MD simulations will provide unparalleled insights into the structure of hybrid materials and materials with engineered disorder.


title: Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agents

abstract: We investigate the challenge of task planning for multi-task embodied agents in open-world environments. Two main difficulties are identified: 1) executing plans in an open-world environment (e.g., Minecraft) necessitates accurate and multi-step reasoning due to the long-term nature of tasks, and 2) as vanilla planners do not consider how easy the current agent can achieve a given sub-task when ordering parallel sub-goals within a complicated plan, the resulting plan could be inefficient or even infeasible. To this end, we propose "$\underline{D}$escribe, $\underline{E}$xplain, $\underline{P}$lan and $\underline{S}$elect" ($\textbf{DEPS}$), an interactive planning approach based on Large Language Models (LLMs). DEPS facilitates better error correction on initial LLM-generated $\textit{plan}$ by integrating $\textit{description}$ of the plan execution process and providing self-$\textit{explanation}$ of feedback when encountering failures during the extended planning phases. Furthermore, it includes a goal $\textit{selector}$, which is a trainable module that ranks parallel candidate sub-goals based on the estimated steps of completion, consequently refining the initial plan. Our experiments mark the milestone of the first zero-shot multi-task agent that can robustly accomplish 70+ Minecraft tasks and nearly double the overall performances. Further testing reveals our method's general effectiveness in popularly adopted non-open-ended domains as well (i.e., ALFWorld and tabletop manipulation). The ablation and exploratory studies detail how our design beats the counterparts and provide a promising update on the $\texttt{ObtainDiamond}$ grand challenge with our approach. The code is released at https://github.com/CraftJarvis/MC-Planner.


title: Hierarchically Composing Level Generators for the Creation of Complex Structures

abstract: Procedural content generation (PCG) is a growing field, with numerous applications in the video game industry and great potential to help create better games at a fraction of the cost of manual creation. However, much of the work in PCG is focused on generating relatively straightforward levels in simple games, as it is challenging to design an optimisable objective function for complex settings. This limits the applicability of PCG to more complex and modern titles, hindering its adoption in industry. Our work aims to address this limitation by introducing a compositional level generation method that recursively composes simple low-level generators to construct large and complex creations. This approach allows for easily-optimisable objectives and the ability to design a complex structure in an interpretable way by referencing lower-level components. We empirically demonstrate that our method outperforms a non-compositional baseline by more accurately satisfying a designer's functional requirements in several tasks. Finally, we provide a qualitative showcase (in Minecraft) illustrating the large and complex, but still coherent, structures that were generated using simple base generators.


title: Uniform Bounds on S-Integral Torsion Points for $\mathbb{G}_m$ and Elliptic Curves

abstract: Let $K$ be a number field, $S$ a finite set of places. For $\mathbb{G}_m$ or an elliptic curve $E$ defined over $K$, we establish uniformity results on the number of $S$-integral torsion points relative to a non-torsion point $\beta$, as $\beta$ varies over number fields of bounded degree. In particular for $\mathbb{G}_m$, if $D$ is a positive integer, we prove a uniform bound on the degree of a torsion point $\zeta$ that is $S$-integral relative to a non-torsion point $\beta$ with degree $\leq D$.


title: Causal Inference Based Single-branch Ensemble Trees For Uplift Modeling

abstract: In this manuscript (ms), we propose causal inference based single-branch ensemble trees for uplift modeling, namely CIET. Different from standard classification methods for predictive probability modeling, CIET aims to achieve the change in the predictive probability of outcome caused by an action or a treatment. According to our CIET, two partition criteria are specifically designed to maximize the difference in outcome distribution between the treatment and control groups. Next, a novel single-branch tree is built by taking a top-down node partition approach, and the remaining samples are censored since they are not covered by the upper node partition logic. Repeating the tree-building process on the censored data, single-branch ensemble trees with a set of inference rules are thus formed. Moreover, CIET is experimentally demonstrated to outperform previous approaches for uplift modeling in terms of both area under uplift curve (AUUC) and Qini coefficient significantly. At present, CIET has already been applied to online personal loans in a national financial holdings group in China. CIET will also be of use to analysts applying machine learning techniques to causal inference in broader business domains such as web advertising, medicine and economics.


title: Effects of gravitational lensing by Kaluza-Klein black holes on neutrino oscillations

abstract: We study gravitational lensing of neutrinos in a Kaluza-Klein black hole spacetime and compare the oscillation probabilities of neutrinos with the case of lensing by black holes in General Relativity. We show that measuring neutrino oscillations in curved spacetimes may allow us to distinguish the two kinds of black holes. This promises to become an useful tool for future measurements of the properties of black hole candidates and possibly help to constrain the validity of alternative theories of gravity.


abstract: The Hamiltonian formulation for perfect fluid equations with the l-conformal Galilei symmetry is proposed. For an arbitrary half-integer value of the parameter l, the Hamilton and non-canonical Poisson brackets are found, in terms of which the original higher derivative equations of motion take the conventional Hamiltonian form. The full set of conserved charges is found and their algebra is established.