title: On extremal spectral radius of blow-up uniform hypergraphs

abstract: Let $G$ be an $r$-uniform hypergraph of order $t$ and $\rho(G)$ is the spectral radius of $\mathcal{A}(G)$, where $\mathcal{A}(G)$ is the adjacency tensor of $G$. A blow-up of $G$ respected to a positive integer vector $(n_{1}, n_{2},\ldots,n_{t})$, denoted by $G \circ (n_{1}, n_{2},\ldots,n_{t})$, is an $r$-uniform hypergraph obtained from $G$ by replacing each vertex $j$ of $G$ with a class of vertices $V_{j}$ of size $n_{j}\ge 1$ and if $\{j_{1},j_{2},\ldots,j_{r}\}\in E(G)$, then $\{v_{i_1},v_{i_2},\ldots,v_{i_r}\}\in E(H)$ for every $v_{i_{1}}\in V_{j_{1}}, v_{i_{2}}\in V_{j_{2}},\ldots, v_{i_{r}}\in V_{j_{r}}$. Let $\mathcal{B}_{n}(G)$ be the set of all the blow-ups of $G$ such that each $n_i\ge 1$ and $\sum_{i=1}^n n_i=n$. Let $K_{t}^{r}$ be the complete $r$-uniform hypergraph of order $t$, and let $SH(m,q,r)$ be the $r$-uniform sunflower hypergraph with $m$ petals and a kernel of size $r-q$ on $t$ vertices. For any $H\in \mathcal{B}_{n}(K_{t}^{r})$, we prove that $$\rho(K_{t}^{r}\circ(n-t+1,1,1,\ldots,1))\leq\rho(H)\leq \rho (T_{t}^{r}(n)),$$ with the left equality holds if and only if $H\cong K_{t}^{r}\circ(n-t+1,1,1,\ldots,1)$, and the right equality holds if and only if $H\cong T_{t}^{r}(n)$, where $T_{t}^{r}(n)$ is the complete $t$-partite $r$-uniform hypergraph of order $n$, with parts of size $\lfloor n / k\rfloor$ or $\lceil n / k \rceil$. For any $H\in \mathcal{B}_{n}(H(m,q,r))$, we determine the exact value of the spectral radius of $H$ and characterize the hypergraphs with maximum spectral radius and minimum spectral radius in $\mathcal{B}_{n}(H(m,q,r))$, respectively.


title: Proximity-induced quasi-one-dimensional superconducting quantum anomalous Hall state: a promising scalable top-down approach towards localized Majorana modes

abstract: In this work, ~100 nm wide quantum anomalous Hall insulator (QAHI) nanoribbons are etched from a two-dimensional QAHI film. One part of the nanoribbon is covered with superconducting Nb, while the other part is connected to an Au lead via two-dimensional QAHI regions. Andreev reflection spectroscopy measurements were performed, and multiple in-gap conductance peaks were observed in three different devices. In the presence of an increasing magnetic field perpendicular to the QAHI film, the multiple in-gap peak structure evolves into a single zero-bias conductance peak (ZBCP). Theoretical simulations suggest that the measurements are consistent with the scenario that the increasing magnetic field drives the nanoribbons from a multi-channel occupied regime to a single channel occupied regime, and that the ZBCP may be induced by zero energy Majorana modes as previously predicted [24]. Although further experiments are needed to clarify the nature of the ZBCP, we provide initial evidence that quasi-1D QAHI nanoribbon/superconductor heterostructures are new and promising platforms for realizing zero-energy Majorana modes.


title: Consistent estimation with the use of orthogonal projections for a linear regression model with errors in the variables

abstract: In this paper, we construct an estimator of an errors-in-variables linear regression model. The regression model leads to a constrained total least squares problems with row and column constraints. Although this problem can be numerically solved, it is unknown whether the solution has consistency in the statistical sense. The proposed estimator can be constructed by the use of orthogonal projections and their properties, its strong consistency is naturally proved. Moreover, our asymptotic analysis proves the strong consistency of the total least squares solution of the problem with row and column constraints.


title: Multi-instrument Comparative Study of Temperature, Number Density, and Emission Measure during the Precursor Phase of a Solar Flare

abstract: We present a multi-instrument study of the two precursor brightenings prior to the M6.5 flare (SOL2015-06-22T18:23) in the NOAA Active Region 12371, with a focus on the temperature (T), electron number density (n), and emission measure (EM). The data used in this study were obtained from four instruments with a variety of wavelengths, i.e., the Solar Dynamics Observatory's Atmospheric Imaging Assembly (AIA), in six extreme ultraviolet (EUV) passbands; the Expanded Owens Valley Solar Array (EOVSA) in microwave (MW); the Reuven Ramaty High Energy Solar Spectroscopic Imager (RHESSI) in hard X-rays (HXR); and the Geostationary Operational Environmental Satellite (GOES) in soft X-rays (SXR). We compare the temporal variations of T, n, and EM derived from the different data sets. Here are the key results. (1) GOES SXR and AIA EUV have almost identical EM variations (1.5-3x10^48 per cm^3) and very similar T variations, from 8 to 15 million Kelvin (MK). (2) Listed from highest to lowest, EOVSA MW provides the highest temperature variations (15-60 MK), followed by RHESSI HXR (10-24 MK), then GOES SXR and AIA EUV (8-15 MK). (3) The EM variation from the RHESSI HXR measurements is always less than the values from AIA EUV and GOES SXR by at most 20 times. The number density variation from EOVSA MW is greater than the value from AIA EUV by at most 100 times. The results quantitatively describe the differences in the thermal parameters at the precursor phase, as measured by different instruments operating at different wavelength regimes and for different emission mechanisms.


title: DiffFashion: Reference-based Fashion Design with Structure-aware Transfer by Diffusion Models

abstract: Image-based fashion design with AI techniques has attracted increasing attention in recent years. We focus on a new fashion design task, where we aim to transfer a reference appearance image onto a clothing image while preserving the structure of the clothing image. It is a challenging task since there are no reference images available for the newly designed output fashion images. Although diffusion-based image translation or neural style transfer (NST) has enabled flexible style transfer, it is often difficult to maintain the original structure of the image realistically during the reverse diffusion, especially when the referenced appearance image greatly differs from the common clothing appearance. To tackle this issue, we present a novel diffusion model-based unsupervised structure-aware transfer method to semantically generate new clothes from a given clothing image and a reference appearance image. In specific, we decouple the foreground clothing with automatically generated semantic masks by conditioned labels. And the mask is further used as guidance in the denoising process to preserve the structure information. Moreover, we use the pre-trained vision Transformer (ViT) for both appearance and structure guidance. Our experimental results show that the proposed method outperforms state-of-the-art baseline models, generating more realistic images in the fashion design task. Code and demo can be found at https://github.com/Rem105-210/DiffFashion.


title: B-BACN: Bayesian Boundary-Aware Convolutional Network for Crack Characterization

abstract: Accurately detecting crack boundaries is crucial for reliability assessment and risk management of structures and materials, such as structural health monitoring, diagnostics, prognostics, and maintenance scheduling. Uncertainty quantification of crack detection is challenging due to various stochastic factors, such as measurement noises, signal processing, and model simplifications. A machine learning-based approach is proposed to quantify both epistemic and aleatoric uncertainties concurrently. We introduce a Bayesian Boundary-Aware Convolutional Network (B-BACN) that emphasizes uncertainty-aware boundary refinement to generate precise and reliable crack boundary detections. The proposed method employs a multi-task learning approach, where we use Monte Carlo Dropout to learn the epistemic uncertainty and a Gaussian sampling function to predict each sample's aleatoric uncertainty. Moreover, we include a boundary refinement loss to B-BACN to enhance the determination of defect boundaries. The proposed method is demonstrated with benchmark experimental results and compared with several existing methods. The experimental results illustrate the effectiveness of our proposed approach in uncertainty-aware crack boundary detection, minimizing misclassification rate, and improving model calibration capabilities.


title: Fermi liquids beyond the forward scattering limit: the role of non-forward scatterings for scale invariance and instabilities

abstract: Landau Fermi liquid theory is a fixed point theory of metals that includes the forward scattering amplitudes as exact marginal couplings. However, the fixed point theory that only includes the strict forward scatterings is non-local in real space. In this paper, we revisit the Fermi liquid theory using the field-theoretic functional renormalization group formalism and show how the scale invariant fixed point emerges as a local theory, which includes not only the forward scatterings but also non-forward scatterings with small but non-zero momentum transfers. In the low-energy limit, the non-forward scattering amplitude takes a scale invariant form. If the bare coupling is attractive beyond a critical strength, the coupling function exhibits a run-away flow drived by non-forward scattering amplitudes, signifying potential instabilities in particle-hole channels. The pairing interaction also obeys a scaling relation if the center of mass momentum of Cooper pairs is comparable with energy. The coupling functions fully capture the universal low-energy dynamics of the collective modes and instabilities of Fermi liquids. The divergence of the cocupling function in the particle-hole channel beyond a critical interaction suggests an instability toward an ordered phase with a momentum that depends on the interaction strength. At the critical interaction, the instability corresponds to the uniform Pomeranchuk or Stoner instability, but the momentum of the leading instability becomes non-zero for stronger attractive interaction. In the particle-particle channel, the coupling function reveals the dynamics of the unstable mode associated with the BCS instability. When an unstable normal metal evolves into the superconducting state, there exists a period in which a superconducting state with spatially non-uniform phase appears due to the presence of unstable Cooperon modes with non-zero momenta.


title: The Role of Semantic Parsing in Understanding Procedural Text

abstract: In this paper, we investigate whether symbolic semantic representations, extracted from deep semantic parsers, can help reasoning over the states of involved entities in a procedural text. We consider a deep semantic parser~(TRIPS) and semantic role labeling as two sources of semantic parsing knowledge. First, we propose PROPOLIS, a symbolic parsing-based procedural reasoning framework. Second, we integrate semantic parsing information into state-of-the-art neural models to conduct procedural reasoning. Our experiments indicate that explicitly incorporating such semantic knowledge improves procedural understanding. This paper presents new metrics for evaluating procedural reasoning tasks that clarify the challenges and identify differences among neural, symbolic, and integrated models.


title: Progress toward superconductor electronics fabrication process with planarized NbN and NbN/Nb layers

abstract: To increase density of superconductor digital and neuromorphic circuits by 10x and reach integration scale of $10^8$ Josephson junctions (JJs) per chip, we developed a new fabrication process on 200-mm wafers, using self-shunted Nb/Al-AlOx/Nb JJs and kinetic inductors. The process has a layer of JJs, a layer of resistors, and 10 fully planarized superconducting layers: 8 Nb layers and 2 layers of high kinetic inductance materials, Mo$_2$N and NbN, with sheet inductance of 8 pH/sq and 3 pH/sq, respectively. NbN films were deposited by two methods: with $T_c$=15.5 K by reactive sputtering of a Nb target in Ar+N$_2$ mixture; with $T_c$ in the range from 9 K to 13 K by plasma-enhanced chemical vapor deposition (PECVD) using Tris(diethylamido)(tert-butylimido)niobium(V) metalorganic precursor. PECVD of NbN was investigated to obtain conformal deposition and filling narrow trenches and vias with high depth-to-width ratios, which was not possible to achieve using sputtering and other physical vapor deposition (PVD) methods at temperatures below $200 ^oC$ required to prevent degradation of Nb/Al-AlOx/Nb junctions. Nb layers with 200 nm thickness are used in the process layer stack as ground planes to maintain a high level of interlayer shielding and low intralayer mutual coupling, for passive transmission lines with wave impedances matching impedances of JJs, typically <=50 $\Omega$, and for low-value inductors. NbN and NbN/Nb bilayer are used for cell inductors. Using NbN/Nb bilayers and individual pattering of both layers to form inductors allowed us to minimize parasitic kinetic inductance associated with interlayer vias and connections to JJs as well as to increase critical currents of the vias. Fabrication details and results of electrical characterization of NbN films, wires, and vias, and comparison with Nb properties are given.


title: Analytical Model of Nonlinear Fiber Propagation for General Dual-Polarization Four-Dimensional Modulation Format

abstract: Coherent dual-polarization (DP) optical transmission systems encode information on the four available degrees of freedom of an optical field: the two polarization states, each with two quadrature components. Such systems naturally operate based on a four-dimensional (4D) signal space. Having a general analytical model to accurately estimate nonlinear interference (NLI) is key to analyze such transmission systems as well as to study how different DP-4D formats are affected by NLI. However, the available models in the literature are not completely general. They either do not apply to the entire DP-4D formats or do not consider all the NLI contributions. In this paper, we develop a model that applies to all DP-4D modulation formats with independent symbols. Our model takes self-channel interference, cross-channel interference and multiple-channel interference effects into account. As an application of our model, we further study the effects of signal-noise interactions in long-haul transmission via the proposed model. When compared to previous results in the literature, our model is more accurate at predicting the contribution of NLI for both low and high dispersion fibers in single- and multi-channel transmission systems. For the NLI, we report an average gap from split step Fourier simulation results below 0.15 dB. The simulation results further show that by considering signal-noise interactions, the proposed model in long-haul transmission can reduce the transmission reach prediction error by 4%.


title: Improved Learning-Augmented Algorithms for the Multi-Option Ski Rental Problem via Best-Possible Competitive Analysis

abstract: In this paper, we present improved learning-augmented algorithms for the multi-option ski rental problem. Learning-augmented algorithms take ML predictions as an added part of the input and incorporates these predictions in solving the given problem. Due to their unique strength that combines the power of ML predictions with rigorous performance guarantees, they have been extensively studied in the context of online optimization problems. Even though ski rental problems are one of the canonical problems in the field of online optimization, only deterministic algorithms were previously known for multi-option ski rental, with or without learning augmentation. We present the first randomized learning-augmented algorithm for this problem, surpassing previous performance guarantees given by deterministic algorithms. Our learning-augmented algorithm is based on a new, provably best-possible randomized competitive algorithm for the problem. Our results are further complemented by lower bounds for deterministic and randomized algorithms, and computational experiments evaluating our algorithms' performance improvements.


title: VQ3D: Learning a 3D-Aware Generative Model on ImageNet

abstract: Recent work has shown the possibility of training generative models of 3D content from 2D image collections on small datasets corresponding to a single object class, such as human faces, animal faces, or cars. However, these models struggle on larger, more complex datasets. To model diverse and unconstrained image collections such as ImageNet, we present VQ3D, which introduces a NeRF-based decoder into a two-stage vector-quantized autoencoder. Our Stage 1 allows for the reconstruction of an input image and the ability to change the camera position around the image, and our Stage 2 allows for the generation of new 3D scenes. VQ3D is capable of generating and reconstructing 3D-aware images from the 1000-class ImageNet dataset of 1.2 million training images. We achieve an ImageNet generation FID score of 16.8, compared to 69.8 for the next best baseline method.


title: Improved Regret Bounds for Linear Adversarial MDPs via Linear Optimization

abstract: Learning Markov decision processes (MDP) in an adversarial environment has been a challenging problem. The problem becomes even more challenging with function approximation, since the underlying structure of the loss function and transition kernel are especially hard to estimate in a varying environment. In fact, the state-of-the-art results for linear adversarial MDP achieve a regret of $\tilde{O}(K^{6/7})$ ($K$ denotes the number of episodes), which admits a large room for improvement. In this paper, we investigate the problem with a new view, which reduces linear MDP into linear optimization by subtly setting the feature maps of the bandit arms of linear optimization. This new technique, under an exploratory assumption, yields an improved bound of $\tilde{O}(K^{4/5})$ for linear adversarial MDP without access to a transition simulator. The new view could be of independent interest for solving other MDP problems that possess a linear structure.


title: Understanding Oversquashing in GNNs through the Lens of Effective Resistance

abstract: Message passing graph neural networks (GNNs) are a popular learning architectures for graph-structured data. However, one problem GNNs experience is oversquashing, where a GNN has difficulty sending information between distant nodes. Understanding and mitigating oversquashing has recently received significant attention from the research community. In this paper, we continue this line of work by analyzing oversquashing through the lens of the effective resistance between nodes in the input graph. Effective resistance intuitively captures the ``strength'' of connection between two nodes by paths in the graph, and has a rich literature spanning many areas of graph theory. We propose to use total effective resistance as a bound of the total amount of oversquashing in a graph and provide theoretical justification for its use. We further develop an algorithm to identify edges to be added to an input graph to minimize the total effective resistance, thereby alleviating oversquashing. We provide empirical evidence of the effectiveness of our total effective resistance based rewiring strategies for improving the performance of GNNs.


title: COMET: Neural Cost Model Explanation Framework

abstract: Cost models predict the cost of executing given assembly code basic blocks on a specific microarchitecture. Recently, neural cost models have been shown to be fairly accurate and easy to construct. They can replace heavily engineered analytical cost models used in mainstream compiler workflows. However, their black-box nature discourages their adoption. In this work, we develop the first framework, COMET, for generating faithful, generalizable, and intuitive explanations for neural cost models. We generate and compare COMET's explanations for the popular neural cost model, Ithemal against those for an accurate CPU simulation-based cost model, uiCA. Our empirical findings show an inverse correlation between the prediction errors of Ithemal and uiCA and the granularity of basic block features in COMET's explanations for them, thus indicating potential reasons for the higher error of Ithemal with respect to uiCA.


title: Adaptive design of experiment via normalizing flows for failure probability estimation

abstract: Failure probability estimation problem is an crucial task in engineering. In this work we consider this problem in the situation that the underlying computer models are extremely expensive, which often arises in the practice, and in this setting, reducing the calls of computer model is of essential importance. We formulate the problem of estimating the failure probability with expensive computer models as an sequential experimental design for the limit state (i.e., the failure boundary) and propose a series of efficient adaptive design criteria to solve the design of experiment (DOE). In particular, the proposed method employs the deep neural network (DNN) as the surrogate of limit state function for efficiently reducing the calls of expensive computer experiment. A map from the Gaussian distribution to the posterior approximation of the limit state is learned by the normalizing flows for the ease of experimental design. Three normalizing-flows-based design criteria are proposed in this work for deciding the design locations based on the different assumption of generalization error. The accuracy and performance of the proposed method is demonstrated by both theory and practical examples.


title: A novel approach for bilevel programs based on Wolfe duality

abstract: This paper considers a bilevel program, which has many applications in practice. To develop effective numerical algorithms, it is generally necessary to transform the bilevel program into a single-level optimization problem. The most popular approach is to replace the lower-level program by its KKT conditions and then the bilevel program can be reformulated as a mathematical program with equilibrium constraints (MPEC for short). However, since the MPEC does not satisfy the Mangasarian-Fromovitz constraint qualification at any feasible point, the well-developed nonlinear programming theory cannot be applied to MPECs directly. In this paper, we apply the Wolfe duality to show that, under very mild conditions, the bilevel program is equivalent to a new single-level reformulation (WDP for short) in the globally and locally optimal sense. We give an example to show that, unlike the MPEC reformulation, WDP may satisfy the Mangasarian-Fromovitz constraint qualification at its feasible points. We give some properties of the WDP reformulation and the relations between the WDP and MPEC reformulations. We further propose a relaxation method for solving WDP and investigate its limiting behavior. Comprehensive numerical experiments indicate that, although solving WDP directly does not perform very well in our tests, the relaxation method based on the WDP reformulation is quite efficient.


title: Predicting the long-term collective behaviour of fish pairs with deep learning

abstract: Modern computing has enhanced our understanding of how social interactions shape collective behaviour in animal societies. Although analytical models dominate in studying collective behaviour, this study introduces a deep learning model to assess social interactions in the fish species Hemigrammus rhodostomus. We compare the results of our deep learning approach to experiments and to the results of a state-of-the-art analytical model. To that end, we propose a systematic methodology to assess the faithfulness of a collective motion model, exploiting a set of stringent individual and collective spatio-temporal observables. We demonstrate that machine learning models of social interactions can directly compete with their analytical counterparts in reproducing subtle experimental observables. Moreover, this work emphasises the need for consistent validation across different timescales, and identifies key design aspects that enable our deep learning approach to capture both short- and long-term dynamics. We also show that our approach can be extended to larger groups without any retraining, and to other fish species, while retaining the same architecture of the deep learning network. Finally, we discuss the added value of machine learning in the context of the study of collective motion in animal groups and its potential as a complementary approach to analytical models.


title: The Metric Completion of the Space of Vector-Valued One-Forms

abstract: The space of full-ranked one-forms on a smooth, orientable, compact manifold (possibly with boundary) is metrically incomplete with respect to the induced geodesic distance of the generalized Ebin metric. We show a distance equality between the induced geodesic distances of the generalized Ebin metric on the space of full-ranked one-forms and the corresponding Riemannian metric defined on each fiber. Using this result we immediately have a concrete description of the metric completion of the space of full-ranked one-forms. Additionally, we study the relationship between the space of full-ranked one-forms and the space of all Riemannian metrics, leading to quotient structures for the space of Riemannian metrics and its completion.


title: Low dimensional bihamiltonian structures of topological type

abstract: We construct local bihamiltonian structures from classical $W$-algebras associated to non-regular nilpotent elements of regular semisimple type in Lie algebras of type $A_2$ and $A_3$. They form exact Poisson pencil, admit a dispersionless limit and their leading terms define logarithmic or trivial Dubrovin-Frobenius manifolds. We calculate the corresponding central invariants which are expected to be constants. In particular, we get Dubrovin- Frobenius manifolds associated to the focused Schr\"{o}dinger equation and Hurwitz space $M_{0;1,0}$ and the corresponding bihamiltonian structures of topological type.


title: Random boundaries: quantifying segmentation uncertainty in solutions to boundary-value problems

abstract: Engineering simulations using boundary-value partial differential equations often implicitly assume that the uncertainty in the location of the boundary has a negligible impact on the output of the simulation. In this work, we develop a novel method for describing the geometric uncertainty in image-derived models and use a naive method for subsequently quantifying a simulation's sensitivity to that uncertainty. A Gaussian random field is constructed to represent the space of possible geometries, based on image-derived quantities such as pixel size, which can then be used to probe the simulation's output space. The algorithm is demonstrated with examples from biomechanics where patient-specific geometries are often segmented from low-resolution, three-dimensional images. These examples show the method's wide applicability with examples using linear elasticity and fluid dynamics. We show that important biomechanical outputs of these example simulations, namely maximum principal stress and wall shear stress, can be highly sensitive to realistic uncertainties in geometry.


title: Scan-Matching based Particle Filtering approach for LIDAR-only Localization

abstract: This paper deals with the development of a localization methodology for autonomous vehicles using only a $3\Dim$ LIDAR sensor. In the context of this paper, localizing a vehicle in a known 3D global map of the environment is essentially to find its global $3\Dim$ pose (position and orientation) within this map. The problem of tracking is then to use sequential LIDAR scan measurement to also estimate other states such as velocity and angular rates, in addition to the global pose of the vehicle. Particle filters are often used in localization and tracking, as in applications of simultaneously localization and mapping. But particle filters become computationally prohibitive with the increase in particles, often required to localize in a large $3\Dim$ map. Further, computing the likelihood of a LIDAR scan for each particle is in itself a computationally expensive task, thus limiting the number of particles that can be used for real time performance. To this end, we propose a hybrid approach that combines the advantages of a particle filter with a global-local scan matching method to better inform the re-sampling stage of the particle filter. Further, we propose to use a pre-computed likelihood grid to speedup the computation of LIDAR scans. Finally, we develop the complete algorithm to extensively leverage parallel processing to achieve near sufficient real-time performance on publicly available KITTI datasets.


title: Sparse random Fourier features based interatomic potentials for high entropy alloys

abstract: Computational modeling of high entropy alloys (HEA) is challenging given the scalability issues of Density functional theory (DFT) and the non-availability of Interatomic potentials (IP) for molecular dynamics simulations (MD). This work presents a computationally efficient IP for modeling complex elemental interactions present in HEAs. The proposed random features-based IP can accurately model melting behaviour along with various process-related defects. The disordering of atoms during the melting process was simulated. Predicted atomic forces are within 0.08 eV/$\unicode{xC5}$ of corresponding DFT forces. MD simulations predictions of mechanical and thermal properties are within 7$\%$ of the DFT values. High-temperature self-diffusion in the alloy system was investigated using the IP. A novel sparse model is also proposed which reduces the computational cost by 94$\%$ without compromising on the force prediction accuracy.


title: SEAM: Searching Transferable Mixed-Precision Quantization Policy through Large Margin Regularization

abstract: Mixed-precision quantization (MPQ) suffers from the time-consuming process of searching the optimal bit-width allocation i.e., the policy) for each layer, especially when using large-scale datasets such as ISLVRC-2012. This limits the practicality of MPQ in real-world deployment scenarios. To address this issue, this paper proposes a novel method for efficiently searching for effective MPQ policies using a small proxy dataset instead of the large-scale dataset used for training the model. Deviating from the established norm of employing a consistent dataset for both model training and MPQ policy search stages, our approach, therefore, yields a substantial enhancement in the efficiency of MPQ exploration. Nonetheless, using discrepant datasets poses challenges in searching for a transferable MPQ policy. Driven by the observation that quantization noise of sub-optimal policy exerts a detrimental influence on the discriminability of feature representations -- manifesting as diminished class margins and ambiguous decision boundaries -- our method aims to identify policies that uphold the discriminative nature of feature representations, i.e., intra-class compactness and inter-class separation. This general and dataset-independent property makes us search for the MPQ policy over a rather small-scale proxy dataset and then the policy can be directly used to quantize the model trained on a large-scale dataset. Our method offers several advantages, including high proxy data utilization, no excessive hyper-parameter tuning, and high searching efficiency. We search high-quality MPQ policies with the proxy dataset that has only 4% of the data scale compared to the large-scale target dataset, achieving the same accuracy as searching directly on the latter, improving MPQ searching efficiency by up to 300 times.


title: Scheduling Coflows for Minimizing the Makespan in Identical Parallel Networks

abstract: With the rapid advancement of technology, parallel computing applications have become increasingly popular and are commonly executed in large data centers. These applications involve two phases: computation and communication, which are executed repeatedly to complete the work. However, due to the ever-increasing demand for computing power, large data centers are struggling to meet the massive communication demands. To address this problem, coflow has been proposed as a networking abstraction that captures communication patterns in data-parallel computing frameworks. This paper focuses on the coflow scheduling problem in identical parallel networks, where the primary objective is to minimize the makespan, which is the maximum completion time of coflows. It is considered one of the most significant $\mathcal{NP}$-hard problems in large data centers. In this paper, we consider two problems: flow-level scheduling and coflow-level scheduling. In the flow-level scheduling problem, distinct flows can be transferred through different network cores, whereas in the coflow-level scheduling problem, all flows must be transferred through the same network core. To address the flow-level scheduling problem, this paper proposes two algorithms: a $(3-\tfrac{2}{m})$-approximation algorithm and a $(\tfrac{8}{3}-\tfrac{2}{3m})$-approximation algorithm, where $m$ represents the number of network cores. For the coflow-level scheduling problem, this paper proposes a $(2m)$-approximation algorithm. Finally, we conduct simulations on our proposed algorithm and Weaver's algorithm, as presented in Huang \textit{et al.} (2020) in the 2020 IEEE International Parallel and Distributed Processing Symposium (IPDPS). We also validate the effectiveness of the proposed algorithms on heterogeneous parallel networks.


title: An in-situ thermoelectric measurement apparatus inside a thermal-evaporator

abstract: At the ultra-thin limit below 20 nm, a film's electrical conductivity, thermal conductivity, or thermoelectricity depends heavily on its thickness. In most studies, each sample is fabricated one at a time, potentially leading to considerable uncertainty in later characterizations. We design and build an in-situ apparatus to measure thermoelectricity during their deposition inside a thermal evaporator. A temperature difference of up to 2 K is generated by a current passing through an on-chip resistor patterned using photolithography. The Seebeck voltage is measured on a Hall bar structure of a film deposited through a shadow mask. The measurement system is calibrated carefully before loading into the thermal evaporator. This in-situ thermoelectricity measurement system has been thoroughly tested on various materials, including Bi, Te, and Bi$_2$Te$_3$, at high temperatures up to 500 K.


title: YOWOv2: A Stronger yet Efficient Multi-level Detection Framework for Real-time Spatio-temporal Action Detection

abstract: Designing a real-time framework for the spatio-temporal action detection task is still a challenge. In this paper, we propose a novel real-time action detection framework, YOWOv2. In this new framework, YOWOv2 takes advantage of both the 3D backbone and 2D backbone for accurate action detection. A multi-level detection pipeline is designed to detect action instances of different scales. To achieve this goal, we carefully build a simple and efficient 2D backbone with a feature pyramid network to extract different levels of classification features and regression features. For the 3D backbone, we adopt the existing efficient 3D CNN to save development time. By combining 3D backbones and 2D backbones of different sizes, we design a YOWOv2 family including YOWOv2-Tiny, YOWOv2-Medium, and YOWOv2-Large. We also introduce the popular dynamic label assignment strategy and anchor-free mechanism to make the YOWOv2 consistent with the advanced model architecture design. With our improvement, YOWOv2 is significantly superior to YOWO, and can still keep real-time detection. Without any bells and whistles, YOWOv2 achieves 87.0 % frame mAP and 52.8 % video mAP with over 20 FPS on the UCF101-24. On the AVA, YOWOv2 achieves 21.7 % frame mAP with over 20 FPS. Our code is available on https://github.com/yjh0410/YOWOv2.


title: Detecting partial synchrony in a complex oscillatory network using pseudo-vortices

abstract: Partial synchronization is characteristic phase dynamics of coupled oscillators on various natural and artificial networks, which can remain undetected due to the complexity of the systems. With an analogy between pairwise asynchrony of oscillators and topological defects, i.e., vortices, in the two-dimensional XY spin model, we propose a robust and data-driven method to identify the partial synchronization on complex networks. The proposed method is based on an integer matrix whose element is pseudo-vorticity that discretely quantifies asynchronous phase dynamics in every two oscillators, which results in graphical and entropic representations of partial synchrony. As a first trial, we apply our method to 200 FitzHugh-Nagumo neurons on a complex small-world network. Partially synchronized chimera states are revealed by discriminating synchronized states even with phase lags. Such phase lags also appear in partial synchronization in chimera states. Our topological, graphical, and entropic method is implemented solely with measurable phase dynamics data, which will lead to a straightforward application to general oscillatory networks including neural networks in the brain.


title: A new boundary of the mapping class group

abstract: Based on the action of the mapping class group on the space of measured foliations, we construct a new boundary of the mapping class group and study the structure of this boundary. As an application, for any point in Teichmuller space, we consider the orbit of this point under the action of the mapping class group and describe the closure of this orbit in the Thurston compactification and the Gardiner-Masur compactification of Teichmuller space. We also construct some new points in the Gardiner-Masur boundary of Teichmuller space.


title: Internal Parameterization of Hyperconnected Quotients

abstract: One of the most fundamental facts in topos theory is the internal parameterization of subtoposes: the bijective correspondence between subtoposes and Lawvere-Tierney topologies. In this paper, we introduce a new but elementary concept, "a local state classifier," and give an analogous internal parameterization of hyperconnected quotients (i.e., hyperconnected geometric morphisms from a topos). As a corollary, we obtain a solution to the Boolean case of the first problem of Lawvere's open problems.


title: Using Artificial Intelligence to aid Scientific Discovery of Climate Tipping Points

abstract: We propose a hybrid Artificial Intelligence (AI) climate modeling approach that enables climate modelers in scientific discovery using a climate-targeted simulation methodology based on a novel combination of deep neural networks and mathematical methods for modeling dynamical systems. The simulations are grounded by a neuro-symbolic language that both enables question answering of what is learned by the AI methods and provides a means of explainability. We describe how this methodology can be applied to the discovery of climate tipping points and, in particular, the collapse of the Atlantic Meridional Overturning Circulation (AMOC). We show how this methodology is able to predict AMOC collapse with a high degree of accuracy using a surrogate climate model for ocean interaction. We also show preliminary results of neuro-symbolic method performance when translating between natural language questions and symbolically learned representations. Our AI methodology shows promising early results, potentially enabling faster climate tipping point related research that would otherwise be computationally infeasible.


title: Deep Reinforcement Learning for Multi-user Massive MIMO with Channel Aging

abstract: The design of beamforming for downlink multi-user massive multi-input multi-output (MIMO) relies on accurate downlink channel state information (CSI) at the transmitter (CSIT). In fact, it is difficult for the base station (BS) to obtain perfect CSIT due to user mobility, and latency/feedback delay (between downlink data transmission and CSI acquisition). Hence, robust beamforming under imperfect CSIT is needed. In this paper, considering multiple antennas at all nodes (base station and user terminals), we develop a multi-agent deep reinforcement learning (DRL) framework for massive MIMO under imperfect CSIT, where the transmit and receive beamforming are jointly designed to maximize the average information rate of all users. Leveraging this DRL-based framework, interference management is explored and three DRL-based schemes, namely the distributed-learning-distributed-processing scheme, partial-distributed-learning-distributed-processing, and central-learning distributed-processing scheme, are proposed and analyzed. This paper 1) highlights the fact that the DRL-based strategies outperform the random action-chosen strategy and the delay-sensitive strategy named as sample-and-hold (SAH) approach, and achieved over 90% of the information rate of two selected benchmarks with lower complexity: the zero-forcing channel-inversion (ZF-CI) with perfect CSIT and the Greedy Beam Selection strategy, 2) demonstrates the inherent robustness of the proposed designs in the presence of channel aging. 3) conducts detailed convergence and scalability analysis on the proposed framework.


title: Large-Scale Knowledge Synthesis and Complex Information Retrieval from Biomedical Documents

abstract: Recent advances in the healthcare industry have led to an abundance of unstructured data, making it challenging to perform tasks such as efficient and accurate information retrieval at scale. Our work offers an all-in-one scalable solution for extracting and exploring complex information from large-scale research documents, which would otherwise be tedious. First, we briefly explain our knowledge synthesis process to extract helpful information from unstructured text data of research documents. Then, on top of the knowledge extracted from the documents, we perform complex information retrieval using three major components- Paragraph Retrieval, Triplet Retrieval from Knowledge Graphs, and Complex Question Answering (QA). These components combine lexical and semantic-based methods to retrieve paragraphs and triplets and perform faceted refinement for filtering these search results. The complexity of biomedical queries and documents necessitates using a QA system capable of handling queries more complex than factoid queries, which we evaluate qualitatively on the COVID-19 Open Research Dataset (CORD-19) to demonstrate the effectiveness and value-add.


title: Splitting Method for Support Vector Machine in Reproducing Kernel Banach Space with Lower Semi-continuous Loss Function

abstract: In this paper, we use the splitting method to solve support vector machine in reproducing kernel Banach space with lower semi-continuous loss function. We equivalently transfer support vector machines in reproducing kernel Banach space with lower semi-continuous loss function to a finite-dimensional tensor Optimization and propose the splitting method based on alternating direction method of multipliers. By Kurdyka-Lojasiewicz inequality, the iterative sequence obtained by this splitting method is globally convergent to a stationary point if the loss function is lower semi-continuous and subanalytic. Finally, several numerical performances demonstrate the effectiveness.


title: Electro-optic frequency combs carrying orbital angular momentum

abstract: To date, orbital angular momentum (OAM) and optical frequency combs (OFCs) are two distinct fields of research without any association. Herein, we generated OFCs with an OAM on each comb line by applying electro-optic phase modulation to the OAM beam. We verified that the OAM characteristic of the sidebands is consistent with that of the pump light. Our study bridges two distinct research fields OFCs and OAM opening the door to various fundamental research avenues and applications, including large-capacity optical communications, high-security optical encryption, multi-dimensional photon entanglement, and synthetic dimensions.


title: Make Your Brief Stroke Real and Stereoscopic: 3D-Aware Simplified Sketch to Portrait Generation

abstract: Creating the photo-realistic version of people sketched portraits is useful to various entertainment purposes. Existing studies only generate portraits in the 2D plane with fixed views, making the results less vivid. In this paper, we present Stereoscopic Simplified Sketch-to-Portrait (SSSP), which explores the possibility of creating Stereoscopic 3D-aware portraits from simple contour sketches by involving 3D generative models. Our key insight is to design sketch-aware constraints that can fully exploit the prior knowledge of a tri-plane-based 3D-aware generative model. Specifically, our designed region-aware volume rendering strategy and global consistency constraint further enhance detail correspondences during sketch encoding. Moreover, in order to facilitate the usage of layman users, we propose a Contour-to-Sketch module with vector quantized representations, so that easily drawn contours can directly guide the generation of 3D portraits. Extensive comparisons show that our method generates high-quality results that match the sketch. Our usability study verifies that our system is greatly preferred by user.


title: Trainability Enhancement of Parameterized Quantum Circuits via Reduced-Domain Parameter Initialization

abstract: Parameterized quantum circuits (PQCs) have been widely used as a machine learning model to explore the potential of achieving quantum advantages for various tasks. However, the training of PQCs is notoriously challenging owing to the phenomenon of plateaus and/or the existence of (exponentially) many spurious local minima. In this work, we propose an efficient parameter initialization strategy with theoretical guarantees. We prove that if the initial domain of each parameter is reduced inversely proportional to the square root of circuit depth, then the magnitude of the cost gradient decays at most polynomially as a function of the depth. Our theoretical results are verified by numerical simulations of variational quantum eigensolver tasks. Moreover, we demonstrate that the reduced-domain initialization strategy can protect specific quantum neural networks from exponentially many spurious local minima. Our results highlight the significance of an appropriate parameter initialization strategy and can be used to enhance the trainability of PQCs in variational quantum algorithms.


title: Electromagnetic turbulence simulation of tokamak edge plasma dynamics and divertor heat load during thermal quench

abstract: The edge plasma turbulence and transport dynamics, as well as the divertor power loads during the thermal quench phase of tokamak disruptions are numerically investigated with BOUT++'s flux-driven, six-field electromagnetic turbulence model. Here a transient yet intense particle and energy sources are applied at the pedestal top to mimic the plasma power drive at the edge induced by a core thermal collapse, which flattens core temperature profile. Interesting features such as surging of divertor heat load (up to 50 times), and broadening of heat flux width (up to 4 times) on the outer divertor target plate, are observed in the simulation, in qualitative agreement with experimental observations. The dramatic changes of divertor heat load and width are due to the enhanced plasma turbulence activities inside the separatrix. Two cross-field transport mechanisms, namely the $E\times B$ turbulent convection and the stochastic parallel advection/conduction, are identified to play important roles in this process. Firstly, elevated edge pressure gradient drives instabilities and subsequent turbulence in the entire pedestal region. The enhanced turbulence not only transports particles and energy radially across the separatrix via $E\times B$ convection which causes the initial divertor heat load burst, but also induces an amplified magnetic fluctuation $\tilde{B}$. Once the magnetic fluctuation is large enough to break the magnetic flux surface, magnetic flutter effect provides an additional radial transport channel. In the late stage of our simulation, $|\tilde{B}_r/B_0|$ reaches to $10^{-4}$ level that completely breaks magnetic flux surfaces such that stochastic field-lines are directly connecting pedestal top plasma to the divertor target plates or first wall, further contributing to the divertor heat flux width broadening.


title: BLIAM: Literature-based Data Synthesis for Synergistic Drug Combination Prediction

abstract: Language models pre-trained on scientific literature corpora have substantially advanced scientific discovery by offering high-quality feature representations for downstream applications. However, these features are often not interpretable, and thus can reveal limited insights to domain experts. Instead of obtaining features from language models, we propose BLIAM, a literature-based data synthesis approach to directly generate training data points that are interpretable and model-agnostic to downstream applications. The key idea of BLIAM is to create prompts using existing training data and then use these prompts to synthesize new data points. BLIAM performs these two steps iteratively as new data points will define more informative prompts and new prompts will in turn synthesize more accurate data points. Notably, literature-based data augmentation might introduce data leakage since labels of test data points in downstream applications might have already been mentioned in the language model corpus. To prevent such leakage, we introduce GDSC-combo, a large-scale drug combination discovery dataset that was published after the biomedical language model was trained. We found that BLIAM substantially outperforms a non-augmented approach and manual prompting in this rigorous data split setting. BLIAM can be further used to synthesize data points for novel drugs and cell lines that were not even measured in biomedical experiments. In addition to the promising prediction performance, the data points synthesized by BLIAM are interpretable and model-agnostic, enabling in silico augmentation for in vitro experiments.


title: Periodic perturbations of codimension-two bifurcations with a double zero eigenvalue in dynamical systems with symmetry

abstract: We study bifurcation behavior in periodic perturbations of two-dimensional symmetric systems exhibiting codimension-two bifurcations with a double eigenvalue when the frequencies of the perturbation terms are small. We transform the periodically perturbed system to a simpler one which is a periodic perturbation of the normal form for codimension-two bifurcations with a double zero eigenvalue and symmetry, and apply the subharmonic and homoclinic Melnikov methods to analyze bifurcations occurring in the system. In particular, we show that there exist transverse homoclinic or heteroclinic orbits, which yield chaotic dynamics, in wide parameter regions. These results can be applied to three or higher-dimensional systems and even to infinite-dimensional systems with the assistance of center manifold reduction and the invariant manifold theory. We illustrate our theory for a pendulum subjected to position and velocity feedback control when the desired position is periodic in time. We also give numerical computations by the computer tool AUTO to demonstrate the theoretical results.


title: Graph-based Village Level Poverty Identification

abstract: Poverty status identification is the first obstacle to eradicating poverty. Village-level poverty identification is very challenging due to the arduous field investigation and insufficient information. The development of the Web infrastructure and its modeling tools provides fresh approaches to identifying poor villages. Upon those techniques, we build a village graph for village poverty status identification. By modeling the village connections as a graph through the geographic distance, we show the correlation between village poverty status and its graph topological position and identify two key factors (Centrality, Homophily Decaying effect) for identifying villages. We further propose the first graph-based method to identify poor villages. It includes a global Centrality2Vec module to embed village centrality into the dense vector and a local graph distance convolution module that captures the decaying effect. In this paper, we make the first attempt to interpret and identify village-level poverty from a graph perspective.


title: Giant magnetoresistance of Dirac plasma in high-mobility graphene

abstract: The most recognizable feature of graphene's electronic spectrum is its Dirac point around which interesting phenomena tend to cluster. At low temperatures, the intrinsic behavior in this regime is often obscured by charge inhomogeneity but thermal excitations can overcome the disorder at elevated temperatures and create electron-hole plasma of Dirac fermions. The Dirac plasma has been found to exhibit unusual properties including quantum critical scattering and hydrodynamic flow. However, little is known about the plasma's behavior in magnetic fields. Here we report magnetotransport in this quantum-critical regime. In low fields, the plasma exhibits giant parabolic magnetoresistivity reaching >100% in 0.1 T even at room temperature. This is orders of magnitude higher than magnetoresistivity found in any other system at such temperatures. We show that this behavior is unique to monolayer graphene, being underpinned by its massless spectrum and ultrahigh mobility, despite frequent (Planckian-limit) scattering. With the onset of Landau quantization in a few T, where the electron-hole plasma resides entirely on the zeroth Landau level, giant linear magnetoresistivity emerges. It is nearly independent of temperature and can be suppressed by proximity screening, indicating a many-body origin. Clear parallels with magnetotransport in strange metals and so-called quantum linear magnetoresistance predicted for Weyl metals offer an interesting playground to further explore relevant physics using this well-defined quantum-critical 2D system.


title: Scattering of complex gravitino test fields from a gravitational pulse

abstract: Gravitational pulse waves are defined as step functions at the boundaries. In this setting, linearized Rarita-Schwinger equations are precisely solved in Rosen coordinates. It is found that the gravitino's energy-momentum varies with the sandwich wave's shape. The gravitino's energy density will decrease as it crosses the sandwich wave at the test field level since the background won't change.


title: Dynamic Reflections: Optimizing Energy Efficiency in Multi-IRS Empowered Green Networks

abstract: Intelligent Reflecting Surface (IRS) technology is revolutionizing wireless communications by shifting from channel adaptation to a responsive wireless environment. This paper introduces a multi-IRS assisted millimeter wave (mm-wave) system, allowing intelligent on/off control of individual IRS elements. Our objective is to optimize energy efficiency under Quality of Service (QoS) constraints. We propose an algorithm where the Access Point (AP) adjusts transmit beamforming, and IRS elements control phaseshifts and on/off status until convergence. Utilizing a fractional programming (FP) approach for AP beamforming and Simulated Annealing (SA) for IRS subproblems, we achieve a suboptimum optimal solution. A modified nested FP approach addresses the beamforming subproblem. Performance analysis in a practical scenario reveals a significant up to 132.16\% improvement in energy efficiency compared to scenarios with randomly selected IRS on/off status. This highlights the efficacy of our algorithm in enhancing mm-wave communication systems' overall efficiency.


title: Quantum state resolved molecular dipolar collisions over four decades of energy

abstract: Collisions between cold polar molecules represent a fascinating research frontier, but have proven hard to probe experimentally. We report measurements of inelastic cross sections for collisions between NO and ND 3 molecules at energies between 0.1 and 580 cm-1 , with full quantum state resolution. At energies below the 100 cm-1 well depth of the interaction potential, we observed backward glories originating from peculiar U-turn trajectories. At energies below 0.2 cm-1, we observed a breakdown of the Langevin capture model, which we interpreted in terms of a suppressed mutual polarization during the collision, effectively switching off the molecular dipole moments. Scattering calculations based on an ab initio NO-ND3 potential energy surface revealed the crucial role of near-degenerate rotational levels with opposite parity in low-energy dipolar collisions.


title: Reasoning on Feature Models: Compilation-Based vs. Direct Approaches

abstract: Analyzing a Feature Model (FM) and reasoning on the corresponding configuration space is a central task in Software Product Line (SPL) engineering. Problems such as deciding the satisfiability of the FM and eliminating inconsistent parts of the FM have been well resolved by translating the FM into a conjunctive normal form (CNF) formula, and then feeding the CNF to a SAT solver. However, this approach has some limits for other important reasoning issues about the FM, such as counting or enumerating configurations. Two mainstream approaches have been investigated in this direction: (i) direct approaches, using tools based on the CNF representation of the FM at hand, or (ii) compilation-based approaches, where the CNF representation of the FM has first been translated into another representation for which the reasoning queries are easier to address. Our contribution is twofold. First, we evaluate how both approaches compare when dealing with common reasoning operations on FM, namely counting configurations, pointing out one or several configurations, sampling configurations, and finding optimal configurations regarding a utility function. Our experimental results show that the compilation-based is efficient enough to possibly compete with the direct approaches and that the cost of translation (i.e., the compilation time) can be balanced when addressing sufficiently many complex reasoning operations on large configuration spaces. Second, we provide a Java-based automated reasoner that supports these operations for both approaches, thus eliminating the burden of selecting the appropriate tool and approach depending on the operation one wants to perform.


title: SwitchPrompt: Learning Domain-Specific Gated Soft Prompts for Classification in Low-Resource Domains

abstract: Prompting pre-trained language models leads to promising results across natural language processing tasks but is less effective when applied in low-resource domains, due to the domain gap between the pre-training data and the downstream task. In this work, we bridge this gap with a novel and lightweight prompting methodology called SwitchPrompt for the adaptation of language models trained on datasets from the general domain to diverse low-resource domains. Using domain-specific keywords with a trainable gated prompt, SwitchPrompt offers domain-oriented prompting, that is, effective guidance on the target domains for general-domain language models. Our few-shot experiments on three text classification benchmarks demonstrate the efficacy of the general-domain pre-trained language models when used with SwitchPrompt. They often even outperform their domain-specific counterparts trained with baseline state-of-the-art prompting methods by up to 10.7% performance increase in accuracy. This result indicates that SwitchPrompt effectively reduces the need for domain-specific language model pre-training.


title: Concentration Bounds for Discrete Distribution Estimation in KL Divergence

abstract: We study the problem of discrete distribution estimation in KL divergence and provide concentration bounds for the Laplace estimator. We show that the deviation from mean scales as $\sqrt{k}/n$ when $n \ge k$, improving upon the best prior result of $k/n$. We also establish a matching lower bound that shows that our bounds are tight up to polylogarithmic factors.

categories: stat.ML cs.DM cs.IT cs.LG math.IT math.PR


title: Error estimation in current noisy quantum computers

abstract: One of the main important features of the noisy intermediate-scale quantum (NISQ) era is the correct evaluation and consideration of errors. In this paper, we analyze the main sources of errors in current (IBM) quantum computers and we present a useful tool (TED-qc) designed to facilitate the total error probability expected for any quantum circuit. We propose this total error probability as the best way to estimate a lower bound for the fidelity in the NISQ era, avoiding the necessity of comparing the quantum calculations with any classical one. In order to contrast the robustness of our tool we compute the total error probability that may occur in three different quantum models: 1) the Ising model, 2) the Quantum-Phase Estimation (QPE), and 3) the Grover's algorithm. For each model, the main quantities of interest are computed and benchmarked against the reference simulator's results as a function of the error probability for a representative and statistically significant sample size. The analysis is satisfactory in more than the $99\%$ of the cases. In addition, we study how error mitigation techniques are able to eliminate the noise induced during the measurement. These results have been calculated for the IBM quantum computers, but both the tool and the analysis can be easily extended to any other quantum computer.


title: Learning gain differences between ChatGPT and human tutor generated algebra hints

abstract: Large Language Models (LLMs), such as ChatGPT, are quickly advancing AI to the frontiers of practical consumer use and leading industries to re-evaluate how they allocate resources for content production. Authoring of open educational resources and hint content within adaptive tutoring systems is labor intensive. Should LLMs like ChatGPT produce educational content on par with human-authored content, the implications would be significant for further scaling of computer tutoring system approaches. In this paper, we conduct the first learning gain evaluation of ChatGPT by comparing the efficacy of its hints with hints authored by human tutors with 77 participants across two algebra topic areas, Elementary Algebra and Intermediate Algebra. We find that 70% of hints produced by ChatGPT passed our manual quality checks and that both human and ChatGPT conditions produced positive learning gains. However, gains were only statistically significant for human tutor created hints. Learning gains from human-created hints were substantially and statistically significantly higher than ChatGPT hints in both topic areas, though ChatGPT participants in the Intermediate Algebra experiment were near ceiling and not even with the control at pre-test. We discuss the limitations of our study and suggest several future directions for the field. Problem and hint content used in the experiment is provided for replicability.


title: Adaptive Value Decomposition with Greedy Marginal Contribution Computation for Cooperative Multi-Agent Reinforcement Learning

abstract: Real-world cooperation often requires intensive coordination among agents simultaneously. This task has been extensively studied within the framework of cooperative multi-agent reinforcement learning (MARL), and value decomposition methods are among those cutting-edge solutions. However, traditional methods that learn the value function as a monotonic mixing of per-agent utilities cannot solve the tasks with non-monotonic returns. This hinders their application in generic scenarios. Recent methods tackle this problem from the perspective of implicit credit assignment by learning value functions with complete expressiveness or using additional structures to improve cooperation. However, they are either difficult to learn due to large joint action spaces or insufficient to capture the complicated interactions among agents which are essential to solving tasks with non-monotonic returns. To address these problems, we propose a novel explicit credit assignment method to address the non-monotonic problem. Our method, Adaptive Value decomposition with Greedy Marginal contribution (AVGM), is based on an adaptive value decomposition that learns the cooperative value of a group of dynamically changing agents. We first illustrate that the proposed value decomposition can consider the complicated interactions among agents and is feasible to learn in large-scale scenarios. Then, our method uses a greedy marginal contribution computed from the value decomposition as an individual credit to incentivize agents to learn the optimal cooperative policy. We further extend the module with an action encoder to guarantee the linear time complexity for computing the greedy marginal contribution. Experimental results demonstrate that our method achieves significant performance improvements in several non-monotonic domains.


title: Lero: A Learning-to-Rank Query Optimizer

abstract: A recent line of works apply machine learning techniques to assist or rebuild cost-based query optimizers in DBMS. While exhibiting superiority in some benchmarks, their deficiencies, e.g., unstable performance, high training cost, and slow model updating, stem from the inherent hardness of predicting the cost or latency of execution plans using machine learning models. In this paper, we introduce a learning-to-rank query optimizer, called Lero, which builds on top of a native query optimizer and continuously learns to improve the optimization performance. The key observation is that the relative order or rank of plans, rather than the exact cost or latency, is sufficient for query optimization. Lero employs a pairwise approach to train a classifier to compare any two plans and tell which one is better. Such a binary classification task is much easier than the regression task to predict the cost or latency, in terms of model efficiency and accuracy. Rather than building a learned optimizer from scratch, Lero is designed to leverage decades of wisdom of databases and improve the native query optimizer. With its non-intrusive design, Lero can be implemented on top of any existing DBMS with minimal integration efforts. We implement Lero and demonstrate its outstanding performance using PostgreSQL. In our experiments, Lero achieves near optimal performance on several benchmarks. It reduces the plan execution time of the native optimizer in PostgreSQL by up to 70% and other learned query optimizers by up to 37%. Meanwhile, Lero continuously learns and automatically adapts to query workloads and changes in data.


title: Robust Representation Learning with Self-Distillation for Domain Generalization

abstract: Despite the recent success of deep neural networks, there remains a need for effective methods to enhance domain generalization using vision transformers. In this paper, we propose a novel domain generalization technique called Robust Representation Learning with Self-Distillation (RRLD) comprising i) intermediate-block self-distillation and ii) augmentation-guided self-distillation to improve the generalization capabilities of transformer-based models on unseen domains. This approach enables the network to learn robust and general features that are invariant to different augmentations and domain shifts while effectively mitigating overfitting to source domains. To evaluate the effectiveness of our proposed method, we perform extensive experiments on PACS and OfficeHome benchmark datasets, as well as an industrial wafer semiconductor defect dataset. The results demonstrate that RRLD achieves robust and accurate generalization performance. We observe an average accuracy improvement in the range of 1.2% to 2.3% over the state-of-the-art on the three datasets.


title: Integrated Backward Second-Harmonic Generation Through Optically Induced Quasi-Phase Matching

abstract: Quasi-phase-matching for efficient backward second-harmonic generation (BSHG) requires sub-$\rm\mu$m poling periods, a non-trivial fabrication feat. For the first time, we report integrated first-order quasi-phase-matched BSHG enabled by seeded all-optical poling. The self-organized grating inscription circumvents all fabrication challenges. We compare backward and forward processes and explain how grating period influences the conversion efficiency. These results showcase unique properties of the coherent photogalvanic effect and how it can bring new nonlinear functionalities to integrated photonics.


title: Model of destruction of montmorillonite crystal structure in a microwave field

abstract: We address amorphization of montmorillonite crystal structure. Powdered montmorillonite samples with an effective particle diameter 630 micrometers were treated by a microwave field with frequency 2,45 GHz and power 750 W for ten minutes in different environments. The first sample was treated in an air environment, the second one in a humid environment. The third sample was a ceramic mass with 10 percent concentration of mixing water (with respect to the total mass). The model describing amorphization is based on results of X-ray analysis. Activation energies were evaluated for covalent and ionic bounds of oxygen ions, hydroxyl groups, and silicon (aluminum) ions. It is shown that the amorphization is carried out in four stages. In fractions of the energy consumption of the last stage the first one consumes 7-9 percent, the second one takes 13-15 percent, and the third one takes 49-59 percent.


title: Regularity of the $p-$Bergman kernel

abstract: We show that the $p-$Bergman kernel $K_p(z)$ on a bounded domain $\Omega$ is of locally $C^{1,1}$ for $p\geq1$.The proof is based on the locally Lipschitz continuity of the off-diagonal $p-$Bergman kernel $K_p(\zeta,z)$ for fixed $\zeta\in \Omega$. Global irregularity of $K_p(\zeta,z)$ is presented for some smooth strongly pseudoconvex domains when $p\gg 1$. As an application of the local $C^{1,1}-$regularity, an upper estimate for the Levi form of $\log K_p(z)$ for $1<p<2$ is provided. Under the condition that the hyperconvexity index of $\Omega$ is positive, we obtain the log-Lipschitz continuity of $p\mapsto{K_p(z)}$ for $1\leq{p}\leq2$.


title: Distributed Symmetry Breaking on Power Graphs via Sparsification

abstract: In this paper, we present efficient distributed algorithms for classical symmetry breaking problems, maximal independent sets (MIS) and ruling sets, in power graphs. We work in the standard CONGEST model of distributed message passing, where the communication network is abstracted as a graph $G$. Typically, the problem instance in CONGEST is identical to the communication network $G$, that is, we perform the symmetry breaking in $G$. In this work, we consider a setting where the problem instance corresponds to a power graph $G^k$, where each node of the communication network $G$ is connected to all of its $k$-hop neighbors. Our main contribution is a deterministic polylogarithmic time algorithm for computing $k$-ruling sets of $G^k$, which (for $k>1$) improves exponentially on the current state-of-the-art runtimes. The main technical ingredient for this result is a deterministic sparsification procedure which may be of independent interest. On top of being a natural family of problems, ruling sets (in power graphs) are well-motivated through their applications in the powerful shattering framework [BEPS JACM'16, Ghaffari SODA'19] (and others). We present randomized algorithms for computing maximal independent sets and ruling sets of $G^k$ in essentially the same time as they can be computed in $G$. We also revisit the shattering algorithm for MIS [BEPS JACM'16] and present different approaches for the post-shattering phase. Our solutions are algorithmically and analytically simpler (also in the LOCAL model) than existing solutions and obtain the same runtime as [Ghaffari SODA'16].


title: Heavy baryons in the Chiral Quark-Soliton Model

abstract: We review applications of the Chiral Quark Soliton Model to heavy baryons and to doubly heavy tetraquarks.


title: Some Entanglement Survives Most Measurements

abstract: To prepare quantum states and extract information, it is often assumed that one can perform a perfectly projective measurement. Such measurements can achieve an uncorrelated system and environment state. However, perfectly projective measurements can be difficult or impossible to perform in practice. We investigate the limitations of repeated non-projective measurements in preparing a quantum system. For an $n$-qubit system initially entangled with its environment and subsequently prepared with measurements, using a sequence of weak measurements, we show that some entanglement remains unless one of the measurement operators becomes perfectly projective through an extreme limiting process. Removing initial (unentangled) correlations between a system and its environment and the scenario where measurement outcomes are not tracked are also discussed. We present results for $n$-qubit and $n$-dimensional input states.


title: simpleKT: A Simple But Tough-to-Beat Baseline for Knowledge Tracing

abstract: Knowledge tracing (KT) is the problem of predicting students' future performance based on their historical interactions with intelligent tutoring systems. Recently, many works present lots of special methods for applying deep neural networks to KT from different perspectives like model architecture, adversarial augmentation and etc., which make the overall algorithm and system become more and more complex. Furthermore, due to the lack of standardized evaluation protocol \citep{liu2022pykt}, there is no widely agreed KT baselines and published experimental comparisons become inconsistent and self-contradictory, i.e., the reported AUC scores of DKT on ASSISTments2009 range from 0.721 to 0.821 \citep{minn2018deep,yeung2018addressing}. Therefore, in this paper, we provide a strong but simple baseline method to deal with the KT task named \textsc{simpleKT}. Inspired by the Rasch model in psychometrics, we explicitly model question-specific variations to capture the individual differences among questions covering the same set of knowledge components that are a generalization of terms of concepts or skills needed for learners to accomplish steps in a task or a problem. Furthermore, instead of using sophisticated representations to capture student forgetting behaviors, we use the ordinary dot-product attention function to extract the time-aware information embedded in the student learning interactions. Extensive experiments show that such a simple baseline is able to always rank top 3 in terms of AUC scores and achieve 57 wins, 3 ties and 16 loss against 12 DLKT baseline methods on 7 public datasets of different domains. We believe this work serves as a strong baseline for future KT research. Code is available at \url{https://github.com/pykt-team/pykt-toolkit}\footnote{We merged our model to the \textsc{pyKT} benchmark at \url{https://pykt.org/}.}.


title: Thermal Creep on Mars: Visualizing a Soil Layer under Tension

abstract: At low ambient pressure, temperature gradients in porous soil lead to a gas flow, called thermal creep. With this regard, Mars is a unique as the conditions for thermal creep to occur in natural soil only exist on this planet in the solar system. Known as Knudsen compressor, thermal creep induces pressure variations. In the case of Mars, there might be a pressure maximum below the very top dust particle layers of the soil, which would support particle lift and might decrease threshold wind velocities necessary to trigger saltation or reduce angles of repose on certain slopes. In laboratory experiments, we applied diffusing wave spectroscopy (DWS) to trace minute motions of grains on the nm-scale in an illuminated simulated soil. This way, DWS visualizes pressure variations. We observe a minimum of motion which we attribute to the pressure maximum ~ 2 mm below the surface. The motion above but especially below that depth characteristically depends on the ambient pressure with a peak at an ambient pressure of about 3 mbar for our sample. This is consistent with earlier work on ejection of particle layers and is in agreement to a thermal creep origin. It underlines the supporting nature of thermal creep for particle lift which might be especially important on Mars.


title: Text-Guided Scene Sketch-to-Photo Synthesis

abstract: We propose a method for scene-level sketch-to-photo synthesis with text guidance. Although object-level sketch-to-photo synthesis has been widely studied, whole-scene synthesis is still challenging without reference photos that adequately reflect the target style. To this end, we leverage knowledge from recent large-scale pre-trained generative models, resulting in text-guided sketch-to-photo synthesis without the need for reference images. To train our model, we use self-supervised learning from a set of photographs. Specifically, we use a pre-trained edge detector that maps both color and sketch images into a standardized edge domain, which reduces the gap between photograph-based edge images (during training) and hand-drawn sketch images (during inference). We implement our method by fine-tuning a latent diffusion model (i.e., Stable Diffusion) with sketch and text conditions. Experiments show that the proposed method translates original sketch images that are not extracted from color images into photos with compelling visual quality.


title: Conservative State Value Estimation for Offline Reinforcement Learning

abstract: Offline reinforcement learning faces a significant challenge of value over-estimation due to the distributional drift between the dataset and the current learned policy, leading to learning failure in practice. The common approach is to incorporate a penalty term to reward or value estimation in the Bellman iterations. Meanwhile, to avoid extrapolation on out-of-distribution (OOD) states and actions, existing methods focus on conservative Q-function estimation. In this paper, we propose Conservative State Value Estimation (CSVE), a new approach that learns conservative V-function via directly imposing penalty on OOD states. Compared to prior work, CSVE allows more effective state value estimation with conservative guarantees and further better policy optimization. Further, we apply CSVE and develop a practical actor-critic algorithm in which the critic does the conservative value estimation by additionally sampling and penalizing the states \emph{around} the dataset, and the actor applies advantage weighted updates extended with state exploration to improve the policy. We evaluate in classic continual control tasks of D4RL, showing that our method performs better than the conservative Q-function learning methods and is strongly competitive among recent SOTA methods.


title: Improving Interpretability of Deep Sequential Knowledge Tracing Models with Question-centric Cognitive Representations

abstract: Knowledge tracing (KT) is a crucial technique to predict students' future performance by observing their historical learning processes. Due to the powerful representation ability of deep neural networks, remarkable progress has been made by using deep learning techniques to solve the KT problem. The majority of existing approaches rely on the \emph{homogeneous question} assumption that questions have equivalent contributions if they share the same set of knowledge components. Unfortunately, this assumption is inaccurate in real-world educational scenarios. Furthermore, it is very challenging to interpret the prediction results from the existing deep learning based KT models. Therefore, in this paper, we present QIKT, a question-centric interpretable KT model to address the above challenges. The proposed QIKT approach explicitly models students' knowledge state variations at a fine-grained level with question-sensitive cognitive representations that are jointly learned from a question-centric knowledge acquisition module and a question-centric problem solving module. Meanwhile, the QIKT utilizes an item response theory based prediction layer to generate interpretable prediction results. The proposed QIKT model is evaluated on three public real-world educational datasets. The results demonstrate that our approach is superior on the KT prediction task, and it outperforms a wide range of deep learning based KT models in terms of prediction accuracy with better model interpretability. To encourage reproducible results, we have provided all the datasets and code at \url{https://pykt.org/}.


title: Primordial black holes and scalar-induced gravitational waves from the perturbations on the inflaton potential in peak theory

abstract: A perturbation on the background inflaton potential can lead inflation into the ultraslow-roll stage and can thus remarkably enhance the power spectrum ${\cal P}_{\cal R}(k)$ of the primordial curvature perturbation on small scales. Such an enhanced ${\cal P}_{\cal R}(k)$ will result in primordial black holes (PBHs), contributing a significant fraction of dark matter, and will simultaneously generate sizable scalar-induced gravitational waves (SIGWs) as a secondorder effect. In this work, we calculate the PBH abundances $f_{\rm PBH}(M)$ and SIGW spectra $\Omega_{\rm GW}(f)$ in peak theory. We obtain the PBHs with desirable abundances in one or two typical mass windows at $10^{-17}\, M_\odot$, $10^{-13}\, M_\odot$, and $30\, M_\odot$, respectively. At the same time, the relevant SIGWs are expected to be observed by the next-generation gravitational wave detectors, without spoiling the current constraint. Especially, the SIGW associated with the PBH of $30\, M_\odot$ can also interpret the potential isotropic stochastic gravitational wave background from the NANOGrav 12.5-year dataset.


title: Learning Graph ARMA Processes from Time-Vertex Spectra

abstract: The modeling of time-varying graph signals as stationary time-vertex stochastic processes permits the inference of missing signal values by efficiently employing the correlation patterns of the process across different graph nodes and time instants. In this study, we propose an algorithm for computing graph autoregressive moving average (graph ARMA) processes based on learning the joint time-vertex power spectral density of the process from its incomplete realizations for the task of signal interpolation. Our solution relies on first roughly estimating the joint spectrum of the process from partially observed realizations and then refining this estimate by projecting it onto the spectrum manifold of the graph ARMA process through convex relaxations. The initially missing signal values are then estimated based on the learnt model. Experimental results show that the proposed approach achieves high accuracy in time-vertex signal estimation problems.


title: Controlling Frequency-Domain Hong-Ou-Mandel Interference via Electromagnetically Induced Transparency

abstract: Hong-Ou-Mandel (HOM) interference is a compelling quantum phenomenon that demonstrates the nonclassical nature of single photons. In this study, we investigate an electromagnetically induced transparency-based double-$\Lambda$ four-wave mixing system from the perspective of quantized light fields. The system can be used to realize efficient HOM interference in the frequency domain. By using the reduced density operator theory, we demonstrate that, although the double-$\Lambda$ medium does not exhibit phase-dependent properties for the closed-loop case of two incident single photons, frequency-domain HOM two-photon interference occurs. For experimentally achievable optical depth conditions, our theory indicates that this double-$\Lambda$ scheme can perform high-fidelity Hadamard gate operations on frequency-encoded single-photon qubits, and thereby generate HOM two-photon NOON states with a fidelity greater than 0.99. Furthermore, we demonstrate that this scheme can be used to realize arbitrary single-qubit gates and two-qubit SWAP gates by simply controlling the laser detuning and phase, exhibiting its multifunctional properties and providing a new route to scalable optical quantum computing.


title: Worst Case and Probabilistic Analysis of the 2-Opt Algorithm for the TSP

abstract: 2-Opt is probably the most basic local search heuristic for the TSP. This heuristic achieves amazingly good results on real world Euclidean instances both with respect to running time and approximation ratio. There are numerous experimental studies on the performance of 2-Opt. However, the theoretical knowledge about this heuristic is still very limited. Not even its worst case running time on 2-dimensional Euclidean instances was known so far. We clarify this issue by presenting, for every $p\in\mathbb{N}$, a family of $L_p$ instances on which 2-Opt can take an exponential number of steps. Previous probabilistic analyses were restricted to instances in which $n$ points are placed uniformly at random in the unit square $[0,1]^2$. We consider a more advanced model in which the points can be placed independently according to general distributions on $[0,1]^d$, for an arbitrary $d\ge 2$. In particular, we allow different distributions for different points. We study the expected number of local improvements in terms of the number $n$ of points and the maximal density $\phi$ of the probability distributions. We show an upper bound on the expected length of any 2-Opt improvement path of $\tilde{O}(n^{4+1/3}\cdot\phi^{8/3})$. When starting with an initial tour computed by an insertion heuristic, the upper bound on the expected number of steps improves even to $\tilde{O}(n^{4+1/3-1/d}\cdot\phi^{8/3})$. If the distances are measured according to the Manhattan metric, then the expected number of steps is bounded by $\tilde{O}(n^{4-1/d}\cdot\phi)$. In addition, we prove an upper bound of $O(\sqrt[d]{\phi})$ on the expected approximation factor with respect to all $L_p$ metrics. Let us remark that our probabilistic analysis covers as special cases the uniform input model with $\phi=1$ and a smoothed analysis with Gaussian perturbations of standard deviation $\sigma$ with $\phi\sim1/\sigma^d$.


title: A lightweight method for detecting dynamic target occlusions by the robot body

abstract: Robot vision is greatly affected by occlusions, which poses challenges to autonomous systems. The robot itself may hide targets of interest from the camera, while it moves within the field of view, leading to failures in task execution. For example, if a target of interest is partially occluded by the robot, detecting and grasping it correctly, becomes very challenging. To solve this problem, we propose a computationally lightweight method to determine the areas that the robot occludes. For this purpose, we use the Unified Robot Description Format (URDF) to generate a virtual depth image of the 3D robot model. Using the virtual depth image, we can effectively determine the partially occluded areas to improve the robustness of the information given by the perception system. Due to the real-time capabilities of the method, it can successfully detect occlusions of moving targets by the moving robot. We validate the effectiveness of the method in an experimental setup using a 6-DoF robot arm and an RGB-D camera by detecting and handling occlusions for two tasks: Pose estimation of a moving object for pickup and human tracking for robot handover. The code is available in \url{https://github.com/auth-arl/virtual\_depth\_image}.


title: UKnow: A Unified Knowledge Protocol for Common-Sense Reasoning and Vision-Language Pre-training

abstract: This work presents a unified knowledge protocol, called UKnow, which facilitates knowledge-based studies from the perspective of data. Particularly focusing on visual and linguistic modalities, we categorize data knowledge into five unit types, namely, in-image, in-text, cross-image, cross-text, and image-text, and set up an efficient pipeline to help construct the multimodal knowledge graph from any data collection. Thanks to the logical information naturally contained in knowledge graph, organizing datasets under UKnow format opens up more possibilities of data usage compared to the commonly used image-text pairs. Following UKnow protocol, we collect, from public international news, a large-scale multimodal knowledge graph dataset that consists of 1,388,568 nodes (with 571,791 vision-related ones) and 3,673,817 triplets. The dataset is also annotated with rich event tags, including 11 coarse labels and 9,185 fine labels. Experiments on four benchmarks demonstrate the potential of UKnow in supporting common-sense reasoning and boosting vision-language pre-training with a single dataset, benefiting from its unified form of knowledge organization. Code, dataset, and models will be made publicly available.


title: Relative plus constructions

abstract: Let $h$ be a connective homology theory. We construct a functorial relative plus construction as a Bousfield localization functor in the category of maps of spaces. It allows us to associate to a pair $(X, H)$ consisting of a connected space $X$ and an $h$-perfect normal subgroup $H$ of the fundamental group $\pi_1(X)$ an $h$-acyclic map $X \rightarrow X^{+h}_H$ inducing the quotient by $H$ on the fundamental group. When $h$ is an ordinary homology theory with coefficients in a commutative ring with unit $R$, this provides a functorial and well-defined counterpart to a construction by cell attachment introduced by Broto, Levi, and Oliver in the spirit of Quillen's plus construction. We also clarify the necessity to use a strongly $R$-perfect group $H$ in characteristic zero.


title: An analysis tool for collision avoidance manoeuvres using aerodynamic drag

abstract: Aerodynamic collision avoidance manoeuvres provide an opportunity for satellites in Low Earth Orbits to reduce the risk during close encounters. With rising numbers of satellites and objects in orbit, satellites experience close encounters more frequently. Especially those satellites without thrusting capabilities face the problem of not being able to performimpulsive evasive manoeuvres. For satellites in Low Earth Orbits, though, perturbing forces due to aerodynamic drag may be used to influence their trajectories, thus offering a possibility to avoid collisions. This work introduces a tool for the analysis of aerodynamic collision avoidance manoeuvres. Current space-weather data are employed to estimate the density the satellite encounters. Achievable in-track separation distances following a variation of the ballistic coefficient through a change in attitude are then derived by evaluating an analytical equation from literature. Considering additional constraints for the attitude, e.g., charging phases, and uncertainties in the used parameters, the influence of a manoeuvre on the conjunction geometry and the collision probability is examined. The university satellite Flying Laptop of the University of Stuttgart is used as an exemplary satellite for analysis, which show the general effectiveness of evasive manoeuvres employing aerodynamic drag. First manoeuvring strategies can be deducted and the influence of parameter uncertainties is assessed.


title: Computing vector partition functions

abstract: A vector partition function is the number of ways to write a vector as a non-negative integer-coefficient sum of the elements of a finite set of vectors $\Delta$. We present a new algorithm for computing closed-form formulas for vector partition functions as quasi-polynomials over a finite set of pointed polyhedral cones, implemented in the ``calculator'' computer algebra system. We include an exposition of previously known theory of vector partition functions. While our results are not new, our exposition is elementary and self-contained.


title: SpeckleNN: A unified embedding for real-time speckle pattern classification in X-ray single-particle imaging with limited labeled examples

abstract: With X-ray free-electron lasers (XFELs), it is possible to determine the three-dimensional structure of noncrystalline nanoscale particles using X-ray single-particle imaging (SPI) techniques at room temperature. Classifying SPI scattering patterns, or "speckles", to extract single hits that are needed for real-time vetoing and three-dimensional reconstruction poses a challenge for high data rate facilities like European XFEL and LCLS-II-HE. Here, we introduce SpeckleNN, a unified embedding model for real-time speckle pattern classification with limited labeled examples that can scale linearly with dataset size. Trained with twin neural networks, SpeckleNN maps speckle patterns to a unified embedding vector space, where similarity is measured by Euclidean distance. We highlight its few-shot classification capability on new never-seen samples and its robust performance despite only tens of labels per classification category even in the presence of substantial missing detector areas. Without the need for excessive manual labeling or even a full detector image, our classification method offers a great solution for real-time high-throughput SPI experiments.


title: Message Passing Meets Graph Neural Networks: A New Paradigm for Massive MIMO Systems

abstract: As one of the core technologies for 5G systems, massive multiple-input multiple-output (MIMO) introduces dramatic capacity improvements along with very high beamforming and spatial multiplexing gains. When developing efficient physical layer algorithms for massive MIMO systems, message passing is one promising candidate owing to the superior performance. However, as their computational complexity increases dramatically with the problem size, the state-of-the-art message passing algorithms cannot be directly applied to future 6G systems, where an exceedingly large number of antennas are expected to be deployed. To address this issue, we propose a model-driven deep learning (DL) framework, namely the AMP-GNN for massive MIMO transceiver design, by considering the low complexity of the AMP algorithm and adaptability of GNNs. Specifically, the structure of the AMP-GNN network is customized by unfolding the approximate message passing (AMP) algorithm and introducing a graph neural network (GNN) module into it. The permutation equivariance property of AMP-GNN is proved, which enables the AMP-GNN to learn more efficiently and to adapt to different numbers of users. We also reveal the underlying reason why GNNs improve the AMP algorithm from the perspective of expectation propagation, which motivates us to amalgamate various GNNs with different message passing algorithms. In the simulation, we take the massive MIMO detection to exemplify that the proposed AMP-GNN significantly improves the performance of the AMP detector, achieves comparable performance as the state-of-the-art DL-based MIMO detectors, and presents strong robustness to various mismatches.


title: Superconductivity in the doped polymerized fullerite clathrate from first principles

abstract: Superconductivity in the new polymerized C60 fullerite clathrate doped with simple metals was investigated through density functional theory methods. The phonon dispersion curves were systematically computed for the clathrate structures containing the guest dopants (Li, Na, K, Be, Mg, Ca, Al, Ga, Ge) in one of the two distinct cages, fullerene-like C60 and sodalite-like C24, exhibited by this structure. Only four of these structures, Li@C24, Na@C24, Ga@C24 and Be@C60, are dynamically stable in the harmonic approximation. They all show superconducting behavior, although their critical temperatures are predicted to be below 2 K.


title: Take a Prior from Other Tasks for Severe Blur Removal

abstract: Recovering clear structures from severely blurry inputs is a challenging problem due to the large movements between the camera and the scene. Although some works apply segmentation maps on human face images for deblurring, they cannot handle natural scenes because objects and degradation are more complex, and inaccurate segmentation maps lead to a loss of details. For general scene deblurring, the feature space of the blurry image and corresponding sharp image under the high-level vision task is closer, which inspires us to rely on other tasks (e.g. classification) to learn a comprehensive prior in severe blur removal cases. We propose a cross-level feature learning strategy based on knowledge distillation to learn the priors, which include global contexts and sharp local structures for recovering potential details. In addition, we propose a semantic prior embedding layer with multi-level aggregation and semantic attention transformation to integrate the priors effectively. We introduce the proposed priors to various models, including the UNet and other mainstream deblurring baselines, leading to better performance on severe blur removal. Extensive experiments on natural image deblurring benchmarks and real-world images, such as GoPro and RealBlur datasets, demonstrate our method's effectiveness and generalization ability.


title: Special functions in quantum phase estimation

abstract: This paper explains existing results for the application of special functions to phase estimation, which is a fundamental topic in quantum information. We focus on two special functions. One is prolate spheroidal wave function, which approximately gives the maximum probability that the difference between the true parameter and the estimate is smaller than a certain threshold. The other is Mathieu function, which exactly gives the optimum estimation under the energy constraint. It also characterizes the uncertainty relation for the position and the momentum for periodic functions.


title: Over-Sampling Strategy in Feature Space for Graphs based Class-imbalanced Bot Detection

abstract: The presence of a large number of bots in Online Social Networks (OSN) leads to undesirable social effects. Graph neural networks (GNNs) are effective in detecting bots as they utilize user interactions. However, class-imbalanced issues can affect bot detection performance. To address this, we propose an over-sampling strategy for GNNs (OS-GNN) that generates samples for the minority class without edge synthesis. First, node features are mapped to a feature space through neighborhood aggregation. Then, we generate samples for the minority class in the feature space. Finally, the augmented features are used to train the classifiers. This framework is general and can be easily extended into different GNN architectures. The proposed framework is evaluated using three real-world bot detection benchmark datasets, and it consistently exhibits superiority over the baselines.