title: 3D Colored Shape Reconstruction from a Single RGB Image through Diffusion

abstract: We propose a novel 3d colored shape reconstruction method from a single RGB image through diffusion model. Diffusion models have shown great development potentials for high-quality 3D shape generation. However, most existing work based on diffusion models only focus on geometric shape generation, they cannot either accomplish 3D reconstruction from a single image, or produce 3D geometric shape with color information. In this work, we propose to reconstruct a 3D colored shape from a single RGB image through a novel conditional diffusion model. The reverse process of the proposed diffusion model is consisted of three modules, shape prediction module, color prediction module and NeRF-like rendering module. In shape prediction module, the reference RGB image is first encoded into a high-level shape feature and then the shape feature is utilized as a condition to predict the reverse geometric noise in diffusion model. Then the color of each 3D point updated in shape prediction module is predicted by color prediction module. Finally, a NeRF-like rendering module is designed to render the colored point cloud predicted by the former two modules to 2D image space to guide the training conditioned only on a reference image. As far as the authors know, the proposed method is the first diffusion model for 3D colored shape reconstruction from a single RGB image. Experimental results demonstrate that the proposed method achieves competitive performance on colored 3D shape reconstruction, and the ablation study validates the positive role of the color prediction module in improving the reconstruction quality of 3D geometric point cloud.


title: NapSS: Paragraph-level Medical Text Simplification via Narrative Prompting and Sentence-matching Summarization

abstract: Accessing medical literature is difficult for laypeople as the content is written for specialists and contains medical jargon. Automated text simplification methods offer a potential means to address this issue. In this work, we propose a summarize-then-simplify two-stage strategy, which we call NapSS, identifying the relevant content to simplify while ensuring that the original narrative flow is preserved. In this approach, we first generate reference summaries via sentence matching between the original and the simplified abstracts. These summaries are then used to train an extractive summarizer, learning the most relevant content to be simplified. Then, to ensure the narrative consistency of the simplified text, we synthesize auxiliary narrative prompts combining key phrases derived from the syntactical analyses of the original text. Our model achieves results significantly better than the seq2seq baseline on an English medical corpus, yielding 3%~4% absolute improvements in terms of lexical similarity, and providing a further 1.1% improvement of SARI score when combined with the baseline. We also highlight shortcomings of existing evaluation methods, and introduce new metrics that take into account both lexical and high-level semantic similarity. A human evaluation conducted on a random sample of the test set further establishes the effectiveness of the proposed approach. Codes and models are released here: https://github.com/LuJunru/NapSS.


title: Compositional Algorithms on Compositional Data: Deciding Sheaves on Presheaves

abstract: Algorithmicists are well-aware that fast dynamic programming algorithms are very often the correct choice when computing on compositional (or even recursive) graphs. Here we initiate the study of how to generalize this folklore intuition to mathematical structures writ large. We achieve this horizontal generality by adopting a categorial perspective which allows us to show that: (1) structured decompositions (a recent, abstract generalization of many graph decompositions) define Grothendieck topologies on categories of data (adhesive categories) and that (2) any computational problem which can be represented as a sheaf with respect to these topologies can be decided in linear time on classes of inputs which admit decompositions of bounded width and whose decomposition shapes have bounded feedback vertex number. This immediately leads to algorithms on objects of any C-set category; these include -- to name but a few examples -- structures such as: symmetric graphs, directed graphs, directed multigraphs, hypergraphs, directed hypergraphs, databases, simplicial complexes, circular port graphs and half-edge graphs. Thus we initiate the bridging of tools from sheaf theory, structural graph theory and parameterized complexity theory; we believe this to be a very fruitful approach for a general, algebraic theory of dynamic programming algorithms. Finally we pair our theoretical results with concrete implementations of our main algorithmic contribution in the AlgebraicJulia ecosystem.


title: Sketch Less Face Image Retrieval: A New Challenge

abstract: In some specific scenarios, face sketch was used to identify a person. However, drawing a complete face sketch often needs skills and takes time, which hinder its widespread applicability in the practice. In this study, we proposed a new task named sketch less face image retrieval (SLFIR), in which the retrieval was carried out at each stroke and aim to retrieve the target face photo using a partial sketch with as few strokes as possible (see Fig.1). Firstly, we developed a method to generate the data of sketch with drawing process, and opened such dataset; Secondly, we proposed a two-stage method as the baseline for SLFIR that (1) A triplet network, was first adopt to learn the joint embedding space shared between the complete sketch and its target face photo; (2) Regarding the sketch drawing episode as a sequence, we designed a LSTM module to optimize the representation of the incomplete face sketch. Experiments indicate that the new framework can finish the retrieval using a partial or pool drawing sketch.


abstract: The tensor functor called $\alpha$-induction arises from a Frobenius algebra object, or a Q-system, in a braided unitary fusion category. In the operator algebraic language, it gives extensions of endomorphism of $N$ to $M$ arising from a subfactor $N\subset M$ of finite index and finite depth giving a braided fusion category of endomorpshisms of $N$. It is also understood in terms of Ocneanu's graphical calculus. We study this $\alpha$-induction for bi-unitary connections, which give a characterization of finite-dimensional nondegenerate commuting squares and gives certain 4-tensors appearing in recent studies of 2-dimensional topological order. We show that the resulting $\alpha$-induced bi-unitary connections are flat if we have a commutative Frobenius algebra, or a local Q-system. Examples related to chiral conformal field theory and the Dynkin diagrams are presented.

categories: math.QA cond-mat.str-el hep-th math-ph math.MP math.OA


title: Characterizing Attribution and Fluency Tradeoffs for Retrieval-Augmented Large Language Models

abstract: Despite recent progress, it has been difficult to prevent semantic hallucinations in generative Large Language Models. One common solution to this is augmenting LLMs with a retrieval system and making sure that the generated output is attributable to the retrieved information. Given this new added constraint, it is plausible to expect that the overall quality of the output will be affected, for example, in terms of fluency. Can scaling language models help? Here we examine the relationship between fluency and attribution in LLMs prompted with retrieved evidence in knowledge-heavy dialog settings. Our experiments were implemented with a set of auto-metrics that are aligned with human preferences. They were used to evaluate a large set of generations, produced under varying parameters of LLMs and supplied context. We show that larger models tend to do much better in both fluency and attribution, and that (naively) using top-k retrieval versus top-1 retrieval improves attribution but hurts fluency. We next propose a recipe that could allow smaller models to both close the gap with larger models and preserve the benefits of top-k retrieval while avoiding its drawbacks.


title: The Braid Indices of the Reverse Parallel Links of Alternating Knots

abstract: The braid indices of most links remain unknown as there is no known universal method that can be used to determine the braid index of an arbitrary knot. This is also the case for alternating knots. In this paper, we show that if $K$ is an alternating knot, then the braid index of any reverse parallel link of $K$ can be precisely determined. More precisely, if $D$ is a reduced diagram of $K$, $v_+(D)$ ($v_-(D)$) is the number of regions in the checkerboard shading of $D$ for which all crossings are positive (negative), $w(D)$ is the writhe of $D$, then the braid index of a reverse parallel link of $K$ with framing $f$, denoted by $\mathbb{K}_f$, is given by the following precise formula $$\textbf{b}(\mathbb{K}_f)=\left\{ \begin{array}{ll} c(D)+2+a(D)-f, &\ {\rm if}\ f < a(D),\\ c(D)+2, &\ {\rm if}\ a(D)\le f \le b(D),\\ c(D)+2-b(D)+f, &\ {\rm if}\ f > b(D),\\ \end{array} \right. $$ where $a(D)=-v_-(D)+w(D)$ and $b(D)=v_+(D)+w(D)$.


title: Generation of genuine all-way entanglement in defect-nuclear spin systems through dynamical decoupling sequences

abstract: Multipartite entangled states are an essential resource for sensing, quantum error correction, and cryptography. Color centers in solids are one of the leading platforms for quantum networking due to the availability of a nuclear spin memory that can be entangled with the optically active electronic spin through dynamical decoupling sequences. Creating electron-nuclear entangled states in these systems is a difficult task as the always-on hyperfine interactions prohibit complete isolation of the target dynamics from the unwanted spin bath. While this emergent cross-talk can be alleviated by prolonging the entanglement generation, the gate durations quickly exceed coherence times. Here we show how to prepare high-quality GHZ$_M$-like states with minimal cross-talk. We introduce the $M$-tangling power of an evolution operator, which allows us to verify genuine all-way correlations. Using experimentally measured hyperfine parameters of an NV center spin in diamond coupled to carbon-13 lattice spins, we show how to use sequential or single-shot entangling operations to prepare GHZ$_M$-like states of up to $M=10$ qubits within time constraints that saturate bounds on $M$-way correlations. We study the entanglement of mixed electron-nuclear states and develop a non-unitary $M$-tangling power which additionally captures correlations arising from all unwanted nuclear spins. We further derive a non-unitary $M$-tangling power which incorporates the impact of electronic dephasing errors on the $M$-way correlations. Finally, we inspect the performance of our protocols in the presence of experimentally reported pulse errors, finding that XY decoupling sequences can lead to high-fidelity GHZ state preparation.


title: Converting between qubits of different forms

abstract: A quantum bit encoding converter between qubits of different forms is experimentally demonstrated, paving the way to efficient networks for optical quantum computing and communication.


title: ASDF: A Differential Testing Framework for Automatic Speech Recognition Systems

abstract: Recent years have witnessed wider adoption of Automated Speech Recognition (ASR) techniques in various domains. Consequently, evaluating and enhancing the quality of ASR systems is of great importance. This paper proposes ASDF, an Automated Speech Recognition Differential Testing Framework for testing ASR systems. ASDF extends an existing ASR testing tool, the CrossASR++, which synthesizes test cases from a text corpus. However, CrossASR++ fails to make use of the text corpus efficiently and provides limited information on how the failed test cases can improve ASR systems. To address these limitations, our tool incorporates two novel features: (1) a text transformation module to boost the number of generated test cases and uncover more errors in ASR systems and (2) a phonetic analysis module to identify on which phonemes the ASR system tend to produce errors. ASDF generates more high-quality test cases by applying various text transformation methods (e.g., change tense) to the texts in failed test cases. By doing so, ASDF can utilize a small text corpus to generate a large number of audio test cases, something which CrossASR++ is not capable of. In addition, ASDF implements more metrics to evaluate the performance of ASR systems from multiple perspectives. ASDF performs phonetic analysis on the identified failed test cases to identify the phonemes that ASR systems tend to transcribe incorrectly, providing useful information for developers to improve ASR systems. The demonstration video of our tool is made online at https://www.youtube.com/watch?v=DzVwfc3h9As. The implementation is available at https://github.com/danielyuenhx/asdf-differential-testing.


title: Procedural generation of meta-reinforcement learning tasks

abstract: Open-endedness stands to benefit from the ability to generate an infinite variety of diverse, challenging environments. One particularly interesting type of challenge is meta-learning ("learning-to-learn"), a hallmark of intelligent behavior. However, the number of meta-learning environments in the literature is limited. Here we describe a parametrized space for simple meta-reinforcement learning (meta-RL) tasks with arbitrary stimuli. The parametrization allows us to randomly generate an arbitrary number of novel simple meta-learning tasks. The parametrization is expressive enough to include many well-known meta-RL tasks, such as bandit problems, the Harlow task, T-mazes, the Daw two-step task and others. Simple extensions allow it to capture tasks based on two-dimensional topological spaces, such as full mazes or find-the-spot domains. We describe a number of randomly generated meta-RL domains of varying complexity and discuss potential issues arising from random generation.


title: A definition of the asymptotic phase for quantum nonlinear oscillators from the Koopman operator viewpoint

abstract: We propose a definition of the asymptotic phase for quantum nonlinear oscillators from the viewpoint of the Koopman operator theory. The asymptotic phase is a fundamental quantity for the analysis of classical limit-cycle oscillators, but it has not been defined explicitly for quantum nonlinear oscillators. In this study, we define the asymptotic phase for quantum oscillatory systems by using the eigenoperator of the backward Liouville operator associated with the fundamental oscillation frequency. By using the quantum van der Pol oscillator with Kerr effect as an example, we illustrate that the proposed asymptotic phase appropriately yields isochronous phase values in both semiclassical and strong quantum regimes.


title: Searching for Unconventional Superfluid in Excitons of Monolayer Semiconductors

abstract: It is well known that two-dimensional (2D) bosons in homogeneous space cannot undergo real Bose-Einstein condensation, and the superfluid to normal phase transition is Berezinskii-Kosterlitz-Thouless (BKT) type, associated with vortex-antivortex pair unbinding. Here we point out a 2D bosonic system whose low energy physics goes beyond conventional paradigm of 2D {\it homogeneous} bosons, i.e., intralayer excitons in monolayer transition metal dichalcogenides. With intrinsic valley-orbit coupling and valley Zeeman energy, exciton dispersion becomes linear at small momentum, giving rise to a series of novel features. The critical temperature of Bose-Einstein condensation of these excitons is nonzero, suggesting true long-range order in 2D homogeneous system. The dispersion of Goldstone mode at long wavelength has the form $\varepsilon(\boldsymbol{q})\sim\sqrt{q}$, in contrast to conventional linear phonon spectrum. The vortex energy deviates from the usual logarithmic form with respect to system size, but instead has an additional linear term. Superfluid to normal phase transition is no longer BKT type for system size beyond a characteristic scale, without discontinuous jump in superfluid density. With the recent experimental progress on exciton fluid at thermal equilibrium in monolayer semiconductors, our work points out an experimentally accessible system to search for unconventional 2D superfluids beyond BKT paradigm.


title: On supersaturation for oddtown and eventown

abstract: We study the supersaturation problems of oddtown and eventown. Given a family $\mathcal A$ of subsets of an $n$ element set, let $op(\mathcal A)$ denote the number of distinct pairs $A,B\in \mathcal A$ for which $|A \cap B|$ is odd. We show that if $\mathcal A$ consists of $n+s$ odd-sized subsets, then $op(\mathcal A)\geq s+2$, which is tight when $s\le n-4$. This disproves a conjecture by O'Neill on the supersaturation problem of oddtown. For the supersaturation problem of eventown, we show that for large enough $n$, if $\mathcal A$ consists of $2^{\lfloor \frac n 2\rfloor}+s$ even-sized subsets, then $op(\mathcal A)\ge s\cdot2^{\lfloor \frac n 2\rfloor-1} $ for any positive integer $s\le \frac{2^{\lfloor\frac n 8\rfloor}} n$. This partially proves a conjecture by O'Neill on the supersaturation problem of eventown. Previously, the correctness of this conjecture was only verified for $s=1$ and $2$. We further provide a twice weaker lower bound in this conjecture for eventown, that is $op(\mathcal{A})\ge s\cdot 2^{\lfloor n/2\rfloor-2}$ for general $n$ and $s$ by using discrete Fourier analysis. Finally, some asymptotic results for the lower bounds of $op(\mathcal A)$ are given when $s$ is large for both problems.


title: Hierarchical Optimization-Derived Learning

abstract: In recent years, by utilizing optimization techniques to formulate the propagation of deep model, a variety of so-called Optimization-Derived Learning (ODL) approaches have been proposed to address diverse learning and vision tasks. Although having achieved relatively satisfying practical performance, there still exist fundamental issues in existing ODL methods. In particular, current ODL methods tend to consider model construction and learning as two separate phases, and thus fail to formulate their underlying coupling and depending relationship. In this work, we first establish a new framework, named Hierarchical ODL (HODL), to simultaneously investigate the intrinsic behaviors of optimization-derived model construction and its corresponding learning process. Then we rigorously prove the joint convergence of these two sub-tasks, from the perspectives of both approximation quality and stationary analysis. To our best knowledge, this is the first theoretical guarantee for these two coupled ODL components: optimization and learning. We further demonstrate the flexibility of our framework by applying HODL to challenging learning tasks, which have not been properly addressed by existing ODL methods. Finally, we conduct extensive experiments on both synthetic data and real applications in vision and other learning tasks to verify the theoretical properties and practical performance of HODL in various application scenarios.


title: Improving the Arrival Time Estimates of Coronal Mass Ejections by Using Magnetohydrodynamic Ensemble Modeling, Heliospheric Imager data, and Machine Learning

abstract: The arrival time prediction of Coronal mass ejections (CMEs) is an area of active research. Many methods with varying levels of complexity have been developed to predict CME arrival. However, the mean absolute error (MAE) of predictions remains above 12 hours, even with the increasing complexity of methods. In this work we develop a new method for CME arrival time prediction that uses magnetohydrodynamic simulations involving data-constrained flux-rope-based CMEs, which are introduced in a data-driven solar wind background. We found that, for 6 CMEs studied in this work, the MAE in arrival time was ~8 hours. We further improved our arrival time predictions by using ensemble modeling and comparing the ensemble solutions with STEREO-A&B heliospheric imager data. This was done by using our simulations to create synthetic J-maps. A machine learning (ML) method called the lasso regression was used for this comparison. Using this approach, we could reduce the MAE to ~4 hours. Another ML method based on the neural networks (NNs) made it possible to reduce the MAE to ~5 hours for the cases when HI data from both STEREO-A&B were available. NNs are capable of providing similar MAE when only the STEREO-A data is used. Our methods also resulted in very encouraging values of standard deviation (precision) of arrival time. The methods discussed in this paper demonstrate significant improvements in the CME arrival time predictions. Our work highlights the importance of using ML techniques in combination with data-constrained magnetohydrodynamic modeling to improve space weather predictions.


title: Lagrangian formalism and Noether-type theorems for second-order delay ODEs

abstract: The Lagrangian formalism for variational problem for second-order delay ordinary differential equations (DODEs) is developed. The Noether-type operator identities and theorems for DODEs of second order are presented. Algebraic construction of integrals for DODEs based on symmetries are demonstrated by examples.


title: Zero-Knowledge Mechanisms

abstract: A powerful feature in mechanism design is the ability to irrevocably commit to the rules of a mechanism. Commitment is achieved by public declaration, which enables players to verify incentive properties in advance and the outcome in retrospect. However, public declaration can reveal superfluous information that the mechanism designer might prefer not to disclose, such as her target function or private costs. Avoiding this may be possible via a trusted mediator; however, the availability of a trusted mediator, especially if mechanism secrecy must be maintained for years, might be unrealistic. We propose a new approach to commitment, and show how to commit to, and run, any given mechanism without disclosing it, while enabling the verification of incentive properties and the outcome -- all without the need for any mediators. Our framework is based on zero-knowledge proofs -- a cornerstone of modern cryptographic theory. Applications include non-mediated bargaining with hidden yet binding offers.


title: 2-local unstable homotopy groups of indecomposable $\mathbf{A}_3^2$ -complexes

abstract: In this paper, we calculate the 2-local unstable homotopy groups of indecomposable $\mathbf{A}_3^2$-complexes. The main technique used is analysing the homotopy property of $J(X,A)$, defined by B. Gray for a CW-pair $(X,A)$, which is homotopy equivalent to the homotopy fibre of the pinch map $X\cup CA\rightarrow \Sigma A$.


title: Windowed Fourier Analysis for Signal Processing on Graph Bundles

abstract: We consider the task of representing signals supported on graph bundles, which are generalizations of product graphs that allow for "twists" in the product structure. Leveraging the localized product structure of a graph bundle, we demonstrate how a suitable partition of unity over the base graph can be used to lift the signal on the graph into a space where a product factorization can be readily applied. Motivated by the locality of this procedure, we demonstrate that bases for the signal spaces of the components of the graph bundle can be lifted in the same way, yielding a basis for the signal space of the total graph. We demonstrate this construction on synthetic graphs, as well as with an analysis of the energy landscape of conformational manifolds in stereochemistry.


title: ReMIX: Regret Minimization for Monotonic Value Function Factorization in Multiagent Reinforcement Learning

abstract: Value function factorization methods have become a dominant approach for cooperative multiagent reinforcement learning under a centralized training and decentralized execution paradigm. By factorizing the optimal joint action-value function using a monotonic mixing function of agents' utilities, these algorithms ensure the consistency between joint and local action selections for decentralized decision-making. Nevertheless, the use of monotonic mixing functions also induces representational limitations. Finding the optimal projection of an unrestricted mixing function onto monotonic function classes is still an open problem. To this end, we propose ReMIX, formulating this optimal projection problem for value function factorization as a regret minimization over the projection weights of different state-action values. Such an optimization problem can be relaxed and solved using the Lagrangian multiplier method to obtain the close-form optimal projection weights. By minimizing the resulting policy regret, we can narrow the gap between the optimal and the restricted monotonic mixing functions, thus obtaining an improved monotonic value function factorization. Our experimental results on Predator-Prey and StarCraft Multiagent Challenge environments demonstrate the effectiveness of our method, indicating the better capabilities of handling environments with non-monotonic value functions.


title: An Efficient Spectral Trust-Region Deflation Method for Multiple Solutions

abstract: It is quite common that a nonlinear partial differential equation (PDE) admits multiple distinct solutions and each solution may carry a unique physical meaning. One typical approach for finding multiple solutions is to use the Newton method with different initial guesses that ideally fall into the basins of attraction confining the solutions. In this paper, we propose a fast and accurate numerical method for multiple solutions comprised of three ingredients: (i) a well-designed spectral-Galerkin discretization of the underlying PDE leading to a nonlinear algebraic system (NLAS) with multiple solutions; (ii) an effective deflation technique to eliminate a known (founded) solution from the other unknown solutions leading to deflated NLAS; and (iii) a viable nonlinear least-squares and trust-region (LSTR) method for solving the NLAS and the deflated NLAS to find the multiple solutions sequentially one by one. We demonstrate through ample examples of differential equations and comparison with relevant existing approaches that the spectral LSTR-Deflation method has the merits: (i) it is quite flexible in choosing initial values, even starting from the same initial guess for finding all multiple solutions; (ii) it guarantees high-order accuracy; and (iii) it is quite fast to locate multiple distinct solutions and explore new solutions which are not reported in literature.


title: AGN candidates in the VVV near-IR galaxy catalogue

abstract: The goal of this work is to search for Active Galactic Nuclei (AGN) in the Galactic disc at very low latitudes with |b| $<$ 2$^\circ$. For this, we studied the five sources from the VVV near-infrared galaxy catalogue that have also WISE counterparts and present variability in the VIrac VAriable Classification Ensemble (VIVACE) catalogue. In the near-infrared colour-colour diagrams, these objects have in general redder colours compared to the rest of the sources in the field. In the mid-infrared ones, they are located in the AGN region, however there is a source that presents the highest interstellar extinction and different mid-IR colours to be a young stellar object (YSO). We also studied the source variability using two different statistical methods. The fractional variability amplitude $\sigma_{rms}$ ranges from 12.6 to 33.8, being in concordance with previous results found for type-1 AGNs. The slopes of the light curves are in the range (2.6$-$4.7) $\times 10^{-4}$ mag/day, also in agreement with results reported on quasars variability. The combination of all these results suggest that four galaxies are type-1 AGN candidates whereas the fifth source likely a YSO candidate.


title: Multi-k magnetic structure and large anomalous Hall effect in candidate magnetic Weyl semimetal NdAlGe

abstract: The magnetic structure, magnetoresistance, and Hall effect of non-centrosymmetric magnetic semimetal NdAlGe are investigated revealing an unusual magnetic state and anomalous transport properties that are associated with the electronic structure of this non-centrosymmetric compound. The magnetization and magnetoresistance measurements are both highly anisotropic and indicate an Ising-like magnetic system. The magnetic structure is complex in that it involves three magnetic ordering vectors including an incommensurate spin density wave and commensurate ferrimagnetic state in zero field. We have discovered a large anomalous Hall conductivity that reaches = 430 {\Omega}-1cm-1 implying that it originates from an intrinsic Berry curvature effect stemming from Weyl nodes found in the electronic structure. These electronic structure calculations indicate the presence of nested Fermi surface pockets with nesting wave vectors similar to the measured magnetic ordering wavevector and the presence of Weyl nodes in proximity to the Fermi surface. We associate the incommensurate magnetic structure with the large anomalous Hall response to be the result of the combination of Fermi surface nesting and the Berry curvature associated with Weyl nodes.


title: MatKB: Semantic Search for Polycrystalline Materials Synthesis Procedures

abstract: In this paper, we present a novel approach to knowledge extraction and retrieval using Natural Language Processing (NLP) techniques for material science. Our goal is to automatically mine structured knowledge from millions of research articles in the field of polycrystalline materials and make it easily accessible to the broader community. The proposed method leverages NLP techniques such as entity recognition and document classification to extract relevant information and build an extensive knowledge base, from a collection of 9.5 Million publications. The resulting knowledge base is integrated into a search engine, which enables users to search for information about specific materials, properties, and experiments with greater precision than traditional search engines like Google. We hope our results can enable material scientists quickly locate desired experimental procedures, compare their differences, and even inspire them to design new experiments. Our website will be available at Github \footnote{https://github.com/Xianjun-Yang/PcMSP.git} soon.


title: Multi-class Brain Tumor Segmentation using Graph Attention Network

abstract: Brain tumor segmentation from magnetic resonance imaging (MRI) plays an important role in diagnostic radiology. To overcome the practical issues in manual approaches, there is a huge demand for building automatic tumor segmentation algorithms. This work introduces an efficient brain tumor summation model by exploiting the advancement in MRI and graph neural networks (GNNs). The model represents the volumetric MRI as a region adjacency graph (RAG) and learns to identify the type of tumors through a graph attention network (GAT) -- a variant of GNNs. The ablation analysis conducted on two benchmark datasets proves that the proposed model can produce competitive results compared to the leading-edge solutions. It achieves mean dice scores of 0.91, 0.86, 0.79, and mean Hausdorff distances in the 95th percentile (HD95) of 5.91, 6.08, and 9.52 mm, respectively, for whole tumor, core tumor, and enhancing tumor segmentation on BraTS2021 validation dataset. On average, these performances are >6\% and >50%, compared to a GNN-based baseline model, respectively, on dice score and HD95 evaluation metrics.


title: Communication and Storage Efficient Federated Split Learning

abstract: Federated learning (FL) is a popular distributed machine learning (ML) paradigm, but is often limited by significant communication costs and edge device computation capabilities. Federated Split Learning (FSL) preserves the parallel model training principle of FL, with a reduced device computation requirement thanks to splitting the ML model between the server and clients. However, FSL still incurs very high communication overhead due to transmitting the smashed data and gradients between the clients and the server in each global round. Furthermore, the server has to maintain separate models for every client, resulting in a significant computation and storage requirement that grows linearly with the number of clients. This paper tries to solve these two issues by proposing a communication and storage efficient federated and split learning (CSE-FSL) strategy, which utilizes an auxiliary network to locally update the client models while keeping only a single model at the server, hence avoiding the communication of gradients from the server and greatly reducing the server resource requirement. Communication cost is further reduced by only sending the smashed data in selected epochs from the clients. We provide a rigorous theoretical analysis of CSE-FSL that guarantees its convergence for non-convex loss functions. Extensive experimental results demonstrate that CSE-FSL has a significant communication reduction over existing FSL techniques while achieving state-of-the-art convergence and model accuracy, using several real-world FL tasks.


title: Persistent Homology to Study Cold Hardiness of Grape Cultivars

abstract: Persistent homology is a branch of computational algebraic topology that studies shapes and extracts features over multiple scales. In this paper, we present an unsupervised approach that uses persistent homology to study divergent behavior in agricultural point cloud data. More specifically, we build persistence diagrams from multidimensional point clouds, and use those diagrams as the basis to compare and contrast different subgroups of the population. We apply the framework to study the cold hardiness behavior of 5 leading grape cultivars, with real data from over 20 growing seasons. Our results demonstrate that persistent homology is able to effectively elucidate divergent behavior among the different cultivars; identify cultivars that exhibit variable behavior across seasons; and identify seasonal correlations.


title: Pruning Deep Neural Networks from a Sparsity Perspective

abstract: In recent years, deep network pruning has attracted significant attention in order to enable the rapid deployment of AI into small devices with computation and memory constraints. Pruning is often achieved by dropping redundant weights, neurons, or layers of a deep network while attempting to retain a comparable test performance. Many deep pruning algorithms have been proposed with impressive empirical success. However, existing approaches lack a quantifiable measure to estimate the compressibility of a sub-network during each pruning iteration and thus may under-prune or over-prune the model. In this work, we propose PQ Index (PQI) to measure the potential compressibility of deep neural networks and use this to develop a Sparsity-informed Adaptive Pruning (SAP) algorithm. Our extensive experiments corroborate the hypothesis that for a generic pruning procedure, PQI decreases first when a large model is being effectively regularized and then increases when its compressibility reaches a limit that appears to correspond to the beginning of underfitting. Subsequently, PQI decreases again when the model collapse and significant deterioration in the performance of the model start to occur. Additionally, our experiments demonstrate that the proposed adaptive pruning algorithm with proper choice of hyper-parameters is superior to the iterative pruning algorithms such as the lottery ticket-based pruning methods, in terms of both compression efficiency and robustness.


title: Predicting Participants' Performance in Programming Contests using Deep Learning Techniques

abstract: In recent days, the number of technology enthusiasts is increasing day by day with the prevalence of technological products and easy access to the internet. Similarly, the amount of people working behind this rapid development is rising tremendously. Computer programmers consist of a large portion of those tech-savvy people. Codeforces, an online programming and contest hosting platform used by many competitive programmers worldwide. It is regarded as one of the most standardized platforms for practicing programming problems and participate in programming contests. In this research, we propose a framework that predicts the performance of any particular contestant in the upcoming competitions as well as predicts the rating after that contest based on their practice and the performance of their previous contests.


title: Solvable Dynamics of Coupled High-Dimensional Generalized Limit-Cycle Oscillators

abstract: We introduce a new model consisting of globally coupled high-dimensional generalized limit-cycle oscillators, which explicitly incorporates the role of amplitude dynamics of individual units in the collective dynamics. In the limit of weak coupling, our model reduces to the $D$-dimensional Kuramoto phase model, akin to a similar classic construction of the well-known Kuramoto phase model from weakly coupled two-dimensional limit-cycle oscillators. For the practically important case of $D=3$, the incoherence of the model is rigorously proved to be stable for negative coupling $(K<0)$ but unstable for positive coupling $(K>0)$; the locked states are shown to exist if $K>0$; in particular, the onset of amplitude death is theoretically predicted. For $D\geq2$, the discrete and continuous spectra for both locked states and amplitude death are governed by two general formulas. Our proposed $D$-dimensional model is physically more reasonable, because it is no longer constrained by fixed amplitude dynamics, which puts the recent studies of the $D$-dimensional Kuramoto phase model on a stronger footing by providing a more general framework for $D$-dimensional limit-cycle oscillators.


title: Trajectory-based Robustness Analysis for Nonlinear Systems

abstract: This paper considers the robustness of an uncertain nonlinear system along a finite-horizon trajectory. The uncertain system is modeled as a connection of a nonlinear system and a perturbation. The analysis relies on three ingredients. First, the nonlinear system is approximated by a linear time-varying (LTV) system via linearization along a trajectory. This linearization introduces an additional forcing input due to the nominal trajectory. Second, the input/output behavior of the perturbation is described by time-domain, integral quadratic constraints (IQCs). Third, a dissipation inequality is formulated to bound the worst-case deviation of an output signal due to the uncertainty. These steps yield a differential linear matrix inequality (DLMI) condition to bound the worst-case performance. The robustness condition is then converted to an equivalent condition in terms of a Riccati Differential Equation. This yields a computational method that avoids heuristics often used to solve DLMIs, e.g. time gridding. The approach is demonstrated by a two-link robotic arm example.


title: The "Power of Few'' Phenomenon: The Sparse Case

abstract: The "majority dynamics" process on a social network begins with an initial phase, where the individuals are split into two competing parties, Red and Blue. Every day, everyone updates their affiliation to match the majority among those of their friends. While studying this process on Erdos-Renyi G(n, p) random graph (with constant density), the authors discovered the "Power of Few" phenomenon, showing that a very small advantage to one side already guarantees that everybody will unanimously join that side after just a few days with overwhelming probability. For example, when p = 1/2, then 10 extra members guarantee this unanimity with a 90% chance, regardless of the value of n. In this paper, we study this phenomenon for sparse random graphs. It is clear that below the connectivity threshold, the phenomenon ceases to hold, as the isolated vertices never change their colors. We show that it holds for every density above the threshold. To make the process more realistic, we also assume that individuals can randomly activate their accounts to post their opinions and observe their neighbors (just as we do on social media). We prove that the phenomenon is robust under this assumption.


title: Topological materials or structures: Origin of higher-order topological states

abstract: Higher-order topological states (HOTS) have been extensively investigated in classical wave systems. They do not exist in the band gaps of infinite materials, while exhibit as the in-gap localized modes once the infinite materials are truncated to be the finite structures. Here, we will experimentally reveal the origin of HOTSs in acoustic systems. We design the hollow acoustic structures exclusively composed of hinge and corner resonators. We present the experimental proof that, despite the lack of surfaces and bulks, the hollow acoustic structures can still support the topologically protected hinge and corner states, indicating that the local configurations of boundaries are the sources for the generation of HOTSs. We then get the composite structures by assembling the 2D and 3D topological hollow acoustic structures, and experimentally observe the robust HOTSs in them. Our results provide a fundamental perspective on HOTSs in periodic structures, and we foresee that these findings will pave the way toward designing new topological devices for energy recovering, information processing, non-destructive testing and acoustic sensing.


title: Transient Attack against the KLJN Secure Key Exchanger

abstract: We demonstrate the security vulnerability of the ideal Kirchhoff-Law-Johnson-Noise (KLJN) key exchanger against transient attacks. Transients start when Alice and Bob connect the wire to their chosen resistor at the beginning of each clock cycle. A transient attack takes place during a short duration of time, before the transients reflected from the end of Alice and Bob mix together. The information leak arises from the fact that Eve (the eavesdropper) monitors the cable, and analyzes the transients during this time period. We will demonstrate such a transient attack, and, then we introduce a defense protocol to protect against the attack. Computer simulations demonstrate that after applying the defense method the information leak becomes negligible.


title: Differentiable Outlier Detection Enable Robust Deep Multimodal Analysis

abstract: Often, deep network models are purely inductive during training and while performing inference on unseen data. Thus, when such models are used for predictions, it is well known that they often fail to capture the semantic information and implicit dependencies that exist among objects (or concepts) on a population level. Moreover, it is still unclear how domain or prior modal knowledge can be specified in a backpropagation friendly manner, especially in large-scale and noisy settings. In this work, we propose an end-to-end vision and language model incorporating explicit knowledge graphs. We also introduce an interactive out-of-distribution (OOD) layer using implicit network operator. The layer is used to filter noise that is brought by external knowledge base. In practice, we apply our model on several vision and language downstream tasks including visual question answering, visual reasoning, and image-text retrieval on different datasets. Our experiments show that it is possible to design models that perform similarly to state-of-art results but with significantly fewer samples and training time.


title: Multi-channel all-optical switching based on coherent perfect absorption in atom-cavity system

abstract: We propose an ultrahigh-efficiency, broadband and multi-channel all-optical switching scheme based on broadband coherent perfect absorption (CPA) in a linear and nonlinear regimes in a cavity quantum electrodynamics (CQED) system. Two separate atomic transitions are excited simultaneously by two signal fields coupled from two ends of an optical cavity under the collective strong coupling condition. Three polariton eigenstates are produced which can be tuned freely by varying system parameters. The output field intensities of multiple channels are zero when the CPA criterion is satisfied. However, destructive quantum interference can be induced by a free-space weak control laser tuned to the multi-polariton excitation. As a consequence, the CQED system acts as a coherent perfect light absorber/transmitter as the control field is turned on/off the polariton resonances. In particular, the proposed scheme may be used to realize broadband multi-throw all-optical switching in the nonlinear excitation regime. The proposed scheme is useful for constructing all-optical routing, all-optical communication networks and various quantum logic elements.


title: Emotion Detection From Social Media Posts

abstract: Over the last few years, social media has evolved into a medium for expressing personal views, emotions, and even business and political proposals, recommendations, and advertisements. We address the topic of identifying emotions from text data obtained from social media posts like Twitter in this research. We have deployed different traditional machine learning techniques such as Support Vector Machines (SVM), Naive Bayes, Decision Trees, and Random Forest, as well as deep neural network models such as LSTM, CNN, GRU, BiLSTM, BiGRU to classify these tweets into four emotion categories (Fear, Anger, Joy, and Sadness). Furthermore, we have constructed a BiLSTM and BiGRU ensemble model. The evaluation result shows that the deep neural network models(BiGRU, to be specific) produce the most promising results compared to traditional machine learning models, with an 87.53 % accuracy rate. The ensemble model performs even better (87.66 %), albeit the difference is not significant. This result will aid in the development of a decision-making tool that visualizes emotional fluctuations.


title: Metaphor Detection with Effective Context Denoising

abstract: We propose a novel RoBERTa-based model, RoPPT, which introduces a target-oriented parse tree structure in metaphor detection. Compared to existing models, RoPPT focuses on semantically relevant information and achieves the state-of-the-art on several main metaphor datasets. We also compare our approach against several popular denoising and pruning methods, demonstrating the effectiveness of our approach in context denoising. Our code and dataset can be found at https://github.com/MajiBear000/RoPPT


title: Projection-based two-sample inference for sparsely observed multivariate functional data

abstract: Modern longitudinal studies collect multiple outcomes as the primary endpoints to understand the complex dynamics of the diseases. Oftentimes, especially in clinical trials, the joint variations among the multidimensional responses play a significant role in assessing the differential characteristics between two or more groups, rather than drawing inferences based on a single outcome. Enclosing the longitudinal design under the umbrella of sparsely observed functional data, we develop a projection-based two-sample significance test to identify the difference between the typical multivariate profiles. The methodology is built upon widely adopted multivariate functional principal component analysis to reduce the dimension of the infinite-dimensional multi-modal functions while preserving the dynamic correlation between the components. The test is applicable to a wide class of (non-stationary) covariance structures of the response, and it detects a significant group difference based on a single p-value, thereby overcoming the issue of adjusting for multiple p-values that arises due to comparing the means in each of components separately. Finite-sample numerical studies demonstrate that the test maintains the type-I error, and is powerful to detect significant group differences, compared to the state-of-the-art testing procedures. The test is carried out on the longitudinally designed TOMMORROW study of individuals at high risk of mild cognitive impairment due to Alzheimer's disease to detect differences in the cognitive test scores between the pioglitazone and the placebo groups.


title: KMT-2021-BLG-1122L: The first microlensing triple stellar system

abstract: We systematically inspect the microlensing data acquired by the KMTNet survey during the previous seasons in order to find anomalous lensing events for which the anomalies in the lensing light curves cannot be explained by the usual binary-lens or binary-source interpretations. From the inspection, we find that interpreting the three lensing events OGLE-2018-BLG-0584, KMT-2018-BLG-2119, and KMT-2021-BLG-1122 requires four-body (lens+source) models, in which either both the lens and source are binaries (2L2S event) or the lens is a triple system (3L1S event). Following the analyses of the 2L2S events presented in \citet{Han2023}, here we present the 3L1S analysis of the KMT-2021-BLG-1122. It is found that the lens of the event KMT-2021-BLG-1122 is composed of three masses, in which the projected separations (normalized to the angular Einstein radius) and mass ratios between the lens companions and the primary are $(s_2, q_2)\sim (1.4, 0.53)$ and $(s_3, q_3) \sim (1.6, 0.24)$. By conducting a Bayesian analysis, we estimate that the masses of the individual lens components are $(M_1, M_2, M_3)\sim (0.47\,M_\odot, 0.24\,M_\odot, 0.11\,M_\odot)$. The companions are separated in projection from the primary by $(a_{\perp,2}, a_{\perp,3})\sim (3.5, 4.0)$~AU. The lens of KMT-2018-BLG-2119 is the first triple stellar system detected via microlensing.


title: Cross-domain Random Pre-training with Prototypes for Reinforcement Learning

abstract: This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible. Unsupervised cross-domain Reinforcement Learning (RL) pre-training shows great potential for challenging continuous visual control but poses a big challenge. In this paper, we propose \textbf{C}ross-domain \textbf{R}andom \textbf{P}re-\textbf{T}raining with \textbf{pro}totypes (CRPTpro), a novel, efficient, and effective self-supervised cross-domain RL pre-training framework. CRPTpro decouples data sampling from encoder pre-training, proposing decoupled random collection to easily and quickly generate a qualified cross-domain pre-training dataset. Moreover, a novel prototypical self-supervised algorithm is proposed to pre-train an effective visual encoder that is generic across different domains. Without finetuning, the cross-domain encoder can be implemented for challenging downstream tasks defined in different domains, either seen or unseen. Compared with recent advanced methods, CRPTpro achieves better performance on downstream policy learning without extra training on exploration agents for data collection, greatly reducing the burden of pre-training. We conduct extensive experiments across eight challenging continuous visual-control domains, including balance control, robot locomotion, and manipulation. CRPTpro significantly outperforms the next best Proto-RL(C) on 11/12 cross-domain downstream tasks with only 54\% wall-clock pre-training time, exhibiting state-of-the-art pre-training performance with greatly improved pre-training efficiency. The complete code is available at https://github.com/liuxin0824/CRPTpro.


title: Anatomical Invariance Modeling and Semantic Alignment for Self-supervised Learning in 3D Medical Image Analysis

abstract: Self-supervised learning (SSL) has recently achieved promising performance for 3D medical image analysis tasks. Most current methods follow existing SSL paradigm originally designed for photographic or natural images, which cannot explicitly and thoroughly exploit the intrinsic similar anatomical structures across varying medical images. This may in fact degrade the quality of learned deep representations by maximizing the similarity among features containing spatial misalignment information and different anatomical semantics. In this work, we propose a new self-supervised learning framework, namely Alice, that explicitly fulfills Anatomical invariance modeling and semantic alignment via elaborately combining discriminative and generative objectives. Alice introduces a new contrastive learning strategy which encourages the similarity between views that are diversely mined but with consistent high-level semantics, in order to learn invariant anatomical features. Moreover, we design a conditional anatomical feature alignment module to complement corrupted embeddings with globally matched semantics and inter-patch topology information, conditioned by the distribution of local image content, which permits to create better contrastive pairs. Our extensive quantitative experiments on three 3D medical image analysis tasks demonstrate and validate the performance superiority of Alice, surpassing the previous best SSL counterpart methods and showing promising ability for united representation learning. Codes are available at https://github.com/alibaba-damo-academy/alice.


title: Evidence for three-dimensional Dirac semimetal state in strongly correlated organic quasi-two-dimensional material

abstract: The three-dimensional Dirac semimetal is distinct from its two-dimensional counterpart due to its dimensionality and symmetry. Here, we observe that molecule-based quasi-two-dimensional Dirac fermion system, $\alpha$-(BEDT-TTF)$_2$I$_3$, exhibits chiral anomaly-induced negative magnetoresistance and planar Hall effect upon entering the coherent inter-layer tunneling regime under high pressure. Time-reversal symmetry is broken due to the strong electronic correlation effect, while the spin-orbit coupling effect is negligible. The system provides an ideal platform for investigating the chiral anomaly physics by controlling dimensionality and strong electronic correlation.


title: Towards Human-Centred Crowd Computing: Software for Better Use of Computational Resources

abstract: Internet-connected smart devices are increasing at an exponential rate. These powerful devices have created a yet-untapped pool of idle resources that can be utilised, among others, for processing data in resource-depleted environments. The idea of bringing together a pool of smart devices for ``crowd computing'' (CC) has been studied in the recent past from an infrastructural feasibility perspective. However, for the CC paradigm to be successful, numerous socio-technical and software engineering (SE), specifically the requirements engineering (RE)-related factors are at play and have not been investigated in the literature. In this paper, we motivate the SE-related aspects of CC and the ideas for implementing mobile apps required for CC scenarios. We present the results of a preliminary study on understanding the human aspects, incentives that motivate users, and CC app requirements, and present our future development plan in this relatively new field of research for SE applications.


title: Persona-based Assessment of Software Engineering Student Research Projects: An Experience Report

abstract: Students enrolled in software engineering degrees are generally required to undertake a research project in their final year through which they demonstrate the ability to conduct research, communicate outcomes, and build in-depth expertise in an area. Assessment in these projects typically involves evaluating the product of their research via a thesis or a similar artifact. However, this misses a range of other factors that go into producing successful software engineers and researchers. Incorporating aspects such as process, attitudes, project complexity, and supervision support into the assessment can provide a more holistic evaluation of the performance likely to better align with the intended learning outcomes. In this paper, we present on our experience of adopting an innovative assessment approach to enhance learning outcomes and research performance in our software engineering research projects. Our approach adopted a task-oriented approach to portfolio assessment that incorporates student personas, frequent formative feedback, delayed summative grading, and standards-aligned outcomes-based assessment. We report upon our continuous improvement journey in adapting tasks and criteria to address the challenges of assessing student research projects. Our lessons learnt demonstrate the value of personas to guide the development of holistic rubrics, giving meaning to grades and focusing staff and student attention on attitudes and skills rather than a product only.


title: Evaluating the Robustness of Discrete Prompts

abstract: Discrete prompts have been used for fine-tuning Pre-trained Language Models for diverse NLP tasks. In particular, automatic methods that generate discrete prompts from a small set of training instances have reported superior performance. However, a closer look at the learnt prompts reveals that they contain noisy and counter-intuitive lexical constructs that would not be encountered in manually-written prompts. This raises an important yet understudied question regarding the robustness of automatically learnt discrete prompts when used in downstream tasks. To address this question, we conduct a systematic study of the robustness of discrete prompts by applying carefully designed perturbations into an application using AutoPrompt and then measure their performance in two Natural Language Inference (NLI) datasets. Our experimental results show that although the discrete prompt-based method remains relatively robust against perturbations to NLI inputs, they are highly sensitive to other types of perturbations such as shuffling and deletion of prompt tokens. Moreover, they generalize poorly across different NLI datasets. We hope our findings will inspire future work on robust discrete prompt learning.


title: Improved Dynamic Regret for Online Frank-Wolfe

abstract: To deal with non-stationary online problems with complex constraints, we investigate the dynamic regret of online Frank-Wolfe (OFW), which is an efficient projection-free algorithm for online convex optimization. It is well-known that in the setting of offline optimization, the smoothness of functions and the strong convexity of functions accompanying specific properties of constraint sets can be utilized to achieve fast convergence rates for the Frank-Wolfe (FW) algorithm. However, for OFW, previous studies only establish a dynamic regret bound of $O(\sqrt{T}(V_T+\sqrt{D_T}+1))$ by utilizing the convexity of problems, where $T$ is the number of rounds, $V_T$ is the function variation, and $D_T$ is the gradient variation. In this paper, we derive improved dynamic regret bounds for OFW by extending the fast convergence rates of FW from offline optimization to online optimization. The key technique for this extension is to set the step size of OFW with a line search rule. In this way, we first show that the dynamic regret bound of OFW can be improved to $O(\sqrt{T(V_T+1)})$ for smooth functions. Second, we achieve a better dynamic regret bound of $O(T^{1/3}(V_T+1)^{2/3})$ when functions are smooth and strongly convex, and the constraint set is strongly convex. Finally, for smooth and strongly convex functions with minimizers in the interior of the constraint set, we demonstrate that the dynamic regret of OFW reduces to $O(V_T+1)$, and can be further strengthened to $O(\min\{P_T^\ast,S_T^\ast,V_T\}+1)$ by performing a constant number of FW iterations per round, where $P_T^\ast$ and $S_T^\ast$ denote the path length and squared path length of minimizers, respectively.


title: Dive into the Resolution Augmentations and Metrics in Low Resolution Face Recognition: A Plain yet Effective New Baseline

abstract: Although deep learning has significantly improved Face Recognition (FR), dramatic performance deterioration may occur when processing Low Resolution (LR) faces. To alleviate this, approaches based on unified feature space are proposed with the sacrifice under High Resolution (HR) circumstances. To deal with the huge domain gap between HR and LR domains and achieve the best on both domains, we first took a closer look at the impacts of several resolution augmentations and then analyzed the difficulty of LR samples from the perspective of the model gradient produced by different resolution samples. Besides, we also find that the introduction of some resolutions could help the learning of lower resolutions. Based on these, we divide the LR samples into three difficulties according to the resolution and propose a more effective Multi-Resolution Augmentation. Then, due to the rapidly increasing domain gap as the resolution decreases, we carefully design a novel and effective metric loss based on a LogExp distance function that provides decent gradients to prevent oscillation near the convergence point or tolerance to small distance errors; it could also dynamically adjust the penalty for errors in different dimensions, allowing for more optimization of dimensions with large errors. Combining these two insights, our model could learn more general knowledge in a wide resolution range of images and balanced results can be achieved by our extremely simple framework. Moreover, the augmentations and metrics are the cornerstones of LRFR, so our method could be considered a new baseline for the LRFR task. Experiments on the LRFR datasets: SCface, XQLFW, and large-scale LRFR dataset: TinyFace demonstrate the effectiveness of our methods, while the degradation on HRFR datasets is significantly reduced.


title: openCFS-Data: Implementation of the Stochastic Noise Generation and Radiation Model (SNGR)

abstract: Preliminary aeroacoustic investigations in competitive industries require rapid numerical simulation techniques to gain initial insight into the flow and acoustic field. Although there are capabilities to resolve virtually all turbulence length scales, these techniques are often impractical in early stages of component development. Therefore, the flow field is typically assessed by a Reynolds-averaged Navier Stokes Simulation. Building upon the results of that flow simulation, a stochastic approach to reconstruct the turbulent velocity fluctuations. In conjunction with a hybrid aeroacoustic workflow, this approach is useful in early stage virtual prototyping of aeroacoustic applications. In this working paper, we present the SNGR algorithm of CFS-Data, the open-source pre-post-processing part of openCFS, with a focus on the computation of aeroacoustic sources.


title: Your Favorite Gameplay Speaks Volumes about You: Predicting User Behavior and Hexad Type

abstract: In recent years, the gamification research community has widely and frequently questioned the effectiveness of one-size-fits-all gamification schemes. In consequence, personalization seems to be an important part of any successful gamification design. Personalization can be improved by understanding user behavior and Hexad player/user type. This paper comes with an original research idea: It investigates whether users' game-related data (collected via various gamer-archetype surveys) can be used to predict their behavioral characteristics and Hexad user types in non-game (but gamified) contexts. The affinity that exists between the concepts of gamification and gaming provided us with the impetus for running this exploratory research. We conducted an initial survey study with 67 Stack Exchange users (as a case study). We discovered that users' gameplay information could reveal valuable and helpful information about their behavioral characteristics and Hexad user types in a non-gaming (but gamified) environment. The results of testing three gamer archetypes (i.e., Bartle, Big Five, and BrainHex) show that they can all help predict users' most dominant Stack Exchange behavioral characteristics and Hexad user type better than a random labeler's baseline. That said, of all the gamer archetypes analyzed in this paper, BrainHex performs the best. In the end, we introduce a research agenda for future work.


title: A novel approach to generate datasets with XAI ground truth to evaluate image models

abstract: With the increased usage of artificial intelligence (AI), it is imperative to understand how these models work internally. These needs have led to the development of a new field called eXplainable artificial intelligence (XAI). This field consists of on a set of techniques that allows us to theoretically determine the cause of the AI decisions. One main issue of XAI is how to verify the works on this field, taking into consideration the lack of ground truth (GT). In this study, we propose a new method to generate datasets with GT. We conducted a set of experiments that compared our GT with real model explanations and obtained excellent results confirming that our proposed method is correct.


title: Room Temperature d$^0$ Ferromagnetism in Carbon Doped LaH$_3$: Insights From Density Functional Theory Simulations

abstract: Employing the state-of-the-art Density Functional Theory with both GGA and hybrid HSE06 functional along with the incorporation of spin-orbit coupling, we have engineered stable room temperature ferromagnetism in non-magnetic LaH$_3$ through C substitution at octahedral and tetrahedral H sites where the induced magnetic moment is mostly contributed by 2p orbital of C atom. It is interesting that the magnetic signature is switched on with an impurity concentration as low as 1.04 at% with a magnetic moment of $\approx$ 1.0 $\mu_B$ per impurity, where the localized behavior of the 2p states of C along with significant exchange splitting energy can be attributed as the origin of the induced magnetic moment. The verification of the Stoner criterion in the material further confirmed the onset of ferromagnetism in the system, and the computed Curie temperature is found to be well above room temperature. Reduced formation energy and requirement of lower impurity concentration ensure practical feasibility towards a spintronic device where room temperature ferromagnetism is established from the non-magnetic host and the dopant.


title: A framework of the transport model for high-order eddy viscosity tensor in two-dimensional turbulent flow

abstract: Motivated by the concept of eddy viscosity tensor in improved Boussinesq hypothesis, a transport model of high-order eddy viscosity tensor in 2D-3C turbulence structure is derived from the second-order moment model by tensorial analysis.


title: Optimal control of a viscous damage model with fatigue

abstract: Motivated by fatigue damage models, this paper addresses optimal control problems governed by a non-smooth system featuring two non-differentiable mappings. This consists of a coupling between a doubly non-smooth history-dependent evolution and an elliptic PDE. After proving the directional differentiability of the associated solution mapping, an optimality system which is stronger than the one obtained by classical smoothening procedures is derived. If one of the non-differentiable mappings becomes smooth, the optimality conditions are of strong stationary type, i.e., equivalent to the primal necessary optimality condition.


title: High Recovery with Fewer Injections: Practical Binary Volumetric Injection Attacks against Dynamic Searchable Encryption

abstract: Searchable symmetric encryption enables private queries over an encrypted database, but it also yields information leakages. Adversaries can exploit these leakages to launch injection attacks (Zhang et al., USENIX'16) to recover the underlying keywords from queries. The performance of the existing injection attacks is strongly dependent on the amount of leaked information or injection. In this work, we propose two new injection attacks, namely BVA and BVMA, by leveraging a binary volumetric approach. We enable adversaries to inject fewer files than the existing volumetric attacks by using the known keywords and reveal the queries by observing the volume of the query results. Our attacks can thwart well-studied defenses (e.g., threshold countermeasure, static padding) without exploiting the distribution of target queries and client databases. We evaluate the proposed attacks empirically in real-world datasets with practical queries. The results show that our attacks can obtain a high recovery rate (>80%) in the best case and a roughly 60% recovery even under a large-scale dataset with a small number of injections (<20 files).


title: Improving Differentiable Architecture Search via Self-Distillation

abstract: Differentiable Architecture Search (DARTS) is a simple yet efficient Neural Architecture Search (NAS) method. During the search stage, DARTS trains a supernet by jointly optimizing architecture parameters and network parameters. During the evaluation stage, DARTS discretizes the supernet to derive the optimal architecture based on architecture parameters. However, recent research has shown that during the training process, the supernet tends to converge towards sharp minima rather than flat minima. This is evidenced by the higher sharpness of the loss landscape of the supernet, which ultimately leads to a performance gap between the supernet and the optimal architecture. In this paper, we propose Self-Distillation Differentiable Neural Architecture Search (SD-DARTS) to alleviate the discretization gap. We utilize self-distillation to distill knowledge from previous steps of the supernet to guide its training in the current step, effectively reducing the sharpness of the supernet's loss and bridging the performance gap between the supernet and the optimal architecture. Furthermore, we introduce the concept of voting teachers, where multiple previous supernets are selected as teachers, and their output probabilities are aggregated through voting to obtain the final teacher prediction. Experimental results on real datasets demonstrate the advantages of our novel self-distillation-based NAS method compared to state-of-the-art alternatives.


title: CILP: Co-simulation based Imitation Learner for Dynamic Resource Provisioning in Cloud Computing Environments

abstract: Intelligent Virtual Machine (VM) provisioning is central to cost and resource efficient computation in cloud computing environments. As bootstrapping VMs is time-consuming, a key challenge for latency-critical tasks is to predict future workload demands to provision VMs proactively. However, existing AI-based solutions tend to not holistically consider all crucial aspects such as provisioning overheads, heterogeneous VM costs and Quality of Service (QoS) of the cloud system. To address this, we propose a novel method, called CILP, that formulates the VM provisioning problem as two sub-problems of prediction and optimization, where the provisioning plan is optimized based on predicted workload demands. CILP leverages a neural network as a surrogate model to predict future workload demands with a co-simulated digital-twin of the infrastructure to compute QoS scores. We extend the neural network to also act as an imitation learner that dynamically decides the optimal VM provisioning plan. A transformer based neural model reduces training and inference overheads while our novel two-phase decision making loop facilitates in making informed provisioning decisions. Crucially, we address limitations of prior work by including resource utilization, deployment costs and provisioning overheads to inform the provisioning decisions in our imitation learning framework. Experiments with three public benchmarks demonstrate that CILP gives up to 22% higher resource utilization, 14% higher QoS scores and 44% lower execution costs compared to the current online and offline optimization based state-of-the-art methods.


title: A Survey on Spectral Graph Neural Networks

abstract: Graph neural networks (GNNs) have attracted considerable attention from the research community. It is well established that GNNs are usually roughly divided into spatial and spectral methods. Despite that spectral GNNs play an important role in both graph signal processing and graph representation learning, existing studies are biased toward spatial approaches, and there is no comprehensive review on spectral GNNs so far. In this paper, we summarize the recent development of spectral GNNs, including model, theory, and application. Specifically, we first discuss the connection between spatial GNNs and spectral GNNs, which shows that spectral GNNs can capture global information and have better expressiveness and interpretability. Next, we categorize existing spectral GNNs according to the spectrum information they use, \ie, eigenvalues or eigenvectors. In addition, we review major theoretical results and applications of spectral GNNs, followed by a quantitative experiment to benchmark some popular spectral GNNs. Finally, we conclude the paper with some future directions.


title: Operation-level Progressive Differentiable Architecture Search

abstract: Differentiable Neural Architecture Search (DARTS) is becoming more and more popular among Neural Architecture Search (NAS) methods because of its high search efficiency and low compute cost. However, the stability of DARTS is very inferior, especially skip connections aggregation that leads to performance collapse. Though existing methods leverage Hessian eigenvalues to alleviate skip connections aggregation, they make DARTS unable to explore architectures with better performance. In the paper, we propose operation-level progressive differentiable neural architecture search (OPP-DARTS) to avoid skip connections aggregation and explore better architectures simultaneously. We first divide the search process into several stages during the search phase and increase candidate operations into the search space progressively at the beginning of each stage. It can effectively alleviate the unfair competition between operations during the search phase of DARTS by offsetting the inherent unfair advantage of the skip connection over other operations. Besides, to keep the competition between operations relatively fair and select the operation from the candidate operations set that makes training loss of the supernet largest. The experiment results indicate that our method is effective and efficient. Our method's performance on CIFAR-10 is superior to the architecture found by standard DARTS, and the transferability of our method also surpasses standard DARTS. We further demonstrate the robustness of our method on three simple search spaces, i.e., S2, S3, S4, and the results show us that our method is more robust than standard DARTS. Our code is available at https://github.com/zxunyu/OPP-DARTS.


title: Improved Competitive Ratio for Edge-Weighted Online Stochastic Matching

abstract: We consider the edge-weighted online stochastic matching problem, in which an edge-weighted bipartite graph G=(I\cup J, E) with offline vertices J and online vertex types I is given. The online vertices have types sampled from I with probability proportional to the arrival rates of online vertex types. The online algorithm must make immediate and irrevocable matching decisions with the objective of maximizing the total weight of the matching. For the problem with general arrival rates, Feldman et al. (FOCS 2009) proposed the Suggested Matching algorithm and showed that it achieves a competitive ratio of 1-1/e \approx 0.632. The ratio has recently been improved to 0.645 by Yan (2022), who proposed the Multistage Suggested Matching (MSM) algorithm. In this paper, we propose the Evolving Suggested Matching (ESM) algorithm, and show that it achieves a competitive ratio of 0.650.


title: Complete Bipartite Partition Relations in Cohen Extensions

abstract: We investigate the effect of adding $\omega_2$ Cohen reals on graphs on $\omega_2$, in particular we show that $\omega_2 \to (\omega_2, \omega : \omega)^2$ holds after forcing with $\mathsf{Add}(\omega, \omega_2)$ in a model of $\mathsf{CH}$. We also prove that this results is in a certain sense optimal as $\mathsf{Add}(\omega, \omega_2)$ forces that $\omega_2 \not\to (\omega_2, \omega : \omega_1)^2$.


title: First-Principles Calculation of the Optical Rotatory Power of Periodic Systems: Modern Theory with Modern Functionals

abstract: An analysis of orbital magnetization in band insulators is provided. It is shown that a previously proposed electronic orbital angular-momentum operator generalizes the ``modern theory of orbital magnetization'' to include non-local Hamiltonians. Expressions for magnetic transition dipole moments needed for the calculation of optical rotation (OR) and other properties are developed. A variety of issues that arise in this context are critically analyzed. These issues include periodicity of the operators, previously proposed band dispersion terms as well as, if and where needed, evaluation of reciprocal space derivatives of orbital coefficients. Our treatment is used to determine the optical rotatory power of band insulators employing a formulation that accounts for electric dipole - electric quadrupole (DQ), as well as electric dipole-magnetic dipole, contributions. An implementation in the public \textsc{Crystal} program is validated against a model finite system and applied to the $\alpha$-quartz mineral through linear-response time-dependent density functional theory with a hybrid functional. The latter calculations confirmed the importance of DQ terms. Agreement against experiment was only possible with i) use of a high quality basis set, ii) inclusion of a fraction of non-local Fock exchange, and iii) account of orbital-relaxation terms in the calculation of response functions.


title: A GNN-Guided Predict-and-Search Framework for Mixed-Integer Linear Programming

abstract: Mixed-integer linear programming (MILP) is widely employed for modeling combinatorial optimization problems. In practice, similar MILP instances with only coefficient variations are routinely solved, and machine learning (ML) algorithms are capable of capturing common patterns across these MILP instances. In this work, we combine ML with optimization and propose a novel predict-and-search framework for efficiently identifying high-quality feasible solutions. Specifically, we first utilize graph neural networks to predict the marginal probability of each variable, and then search for the best feasible solution within a properly defined ball around the predicted solution. We conduct extensive experiments on public datasets, and computational results demonstrate that our proposed framework achieves 51.1% and 9.9% performance improvements to MILP solvers SCIP and Gurobi on primal gaps, respectively.


title: Dual Relation Knowledge Distillation for Object Detection

abstract: Knowledge distillation is an effective method for model compression. However, it is still a challenging topic to apply knowledge distillation to detection tasks. There are two key points resulting in poor distillation performance for detection tasks. One is the serious imbalance between foreground and background features, another one is that small object lacks enough feature representation. To solve the above issues, we propose a new distillation method named dual relation knowledge distillation (DRKD), including pixel-wise relation distillation and instance-wise relation distillation. The pixel-wise relation distillation embeds pixel-wise features in the graph space and applies graph convolution to capture the global pixel relation. By distilling the global pixel relation, the student detector can learn the relation between foreground and background features, and avoid the difficulty of distilling features directly for the feature imbalance issue. Besides, we find that instance-wise relation supplements valuable knowledge beyond independent features for small objects. Thus, the instance-wise relation distillation is designed, which calculates the similarity of different instances to obtain a relation matrix. More importantly, a relation filter module is designed to highlight valuable instance relations. The proposed dual relation knowledge distillation is general and can be easily applied for both one-stage and two-stage detectors. Our method achieves state-of-the-art performance, which improves Faster R-CNN based on ResNet50 from 38.4% to 41.6% mAP and improves RetinaNet based on ResNet50 from 37.4% to 40.3% mAP on COCO 2017.


title: Towards a Field-Theory based Relativistic Quantum Information

abstract: We present our program for the development of quantum informational concepts in relativistic systems in terms of the unequal-time correlation functions of quantum fields. We employ two formalisms that provide the basis for further developments. (i) The Quantum Temporal Probabilities (QTP) Method for quantum field measurements and (ii) the Closed- Time-Path (CTP) formalism for causal time evolutions. We present the main ideas of QTP and show how it relates to the CTP formalism, allowing one to express concepts of measurement theory in terms of path-integrals. We also present many links of our program to non-equilibrium quantum field theories. Details can be found in a recent paper by the authors (arxiv:2208.03696).


title: Generalized Maxwell-Juttner distribution for rotating spinning particle gas

abstract: We consider a statistical mechanics and thermodynamics of a rotating ideal gas of classical relativistic particles with nonzero mass and spin. Applying the Gibbs theory of canonical ensembles for a system rotating with constant angular velocity, we obtain the one-particle distribution function by positions, momenta, and spin variables. By computing the partition function, we obtain various thermodynamic quantities of slowly rotating gas. Both the statistical and thermodynamic approaches demonstrate the polarization of spinning degree of freedom, with the majority of spins being directed along the angular velocity vector. This confirms the presence of chiral effects in the system.


title: Meta-Learning Based Knowledge Extrapolation for Temporal Knowledge Graph

abstract: In the last few years, the solution to Knowledge Graph (KG) completion via learning embeddings of entities and relations has attracted a surge of interest. Temporal KGs(TKGs) extend traditional Knowledge Graphs (KGs) by associating static triples with timestamps forming quadruples. Different from KGs and TKGs in the transductive setting, constantly emerging entities and relations in incomplete TKGs create demand to predict missing facts with unseen components, which is the extrapolation setting. Traditional temporal knowledge graph embedding (TKGE) methods are limited in the extrapolation setting since they are trained within a fixed set of components. In this paper, we propose a Meta-Learning based Temporal Knowledge Graph Extrapolation (MTKGE) model, which is trained on link prediction tasks sampled from the existing TKGs and tested in the emerging TKGs with unseen entities and relations. Specifically, we meta-train a GNN framework that captures relative position patterns and temporal sequence patterns between relations. The learned embeddings of patterns can be transferred to embed unseen components. Experimental results on two different TKG extrapolation datasets show that MTKGE consistently outperforms both the existing state-of-the-art models for knowledge graph extrapolation and specifically adapted KGE and TKGE baselines.


title: Emulator-based Bayesian Inference on Non-Proportional Scintillation Models by Compton-Edge Probing

abstract: Scintillator detector response modelling has become an essential tool in various research fields such as particle and nuclear physics, astronomy or geophysics. Yet, due to the system complexity and the requirement for accurate electron response measurements, model inference and calibration remains a challenge. Here, we propose Compton edge probing to perform non-proportional scintillation model (NPSM) inference for inorganic scintillators. We use laboratory-based gamma-ray radiation measurements with a NaI(Tl) scintillator to perform Bayesian inference on a NPSM. Further, we apply machine learning to emulate the detector response obtained by Monte Carlo simulations. We show that the proposed methodology successfully constrains the NPSM and hereby quantifies the intrinsic resolution. Moreover, using the trained emulators, we can predict the spectral Compton edge dynamics as a function of the parameterized scintillation mechanisms. The presented framework offers a novel way to infer NPSMs for any inorganic scintillator without the need for additional electron response measurements.

categories: physics.ins-det astro-ph.IM cond-mat.mtrl-sci physics.comp-ph physics.data-an


title: Resonance-facilitated three-channel p-wave scattering

abstract: Feshbach resonances of arbitrary width are typically described in terms of two-channel models. Within these models, one usually considers a single dressed resonance, with the option to extend the analysis by including resonant open-channel features that can drastically change the observed threshold effects. For the strong $^{40}\mathrm{K}$ p-wave resonance studied in Ref. \cite{ahmed2021}, the interplay between an open-channel shape resonance and the Feshbach resonance could explain the unexpected nonlinear variation of the binding energy with magnetic field. However, the presented two-channel treatment relies on the introduction of two independent fitting parameters, whereas the typical Breit-Wigner expression would only account for one. This results in an effective magnetic moment that acquires a nonphysical value, which is an indication of a major shortcoming of the two-channel model treatment. In this study, we observe how the presence of a closed-channel shape resonance explains the physical mechanism behind the observations and demonstrates the need of a three-channel treatment. We introduce our novel model as \textit{resonance facilitated}, where all coupling is mediated by the Feshbach state, while there is no direct coupling between the additional channel and the open channel. Notably, the resonance-facilitated structure greatly reduces the complexity of the full three-channel model. The typical Breit-Wigner form of the two-channel Feshbach formalism is retained and the full effect of the added channel can be captured by a single resonance dressing factor, which describes how the free propagation in the Feshbach state is dressed by the added channel.


title: Photon-phonon quantum cloning in optomechanical system

abstract: Quantum cloning is an essential operation in quantum information and quantum computing. Similar to the `copy' operation in classical computing, the cloning of flying bits for further processing from the solid-state quantum bits in storage is an operation frequently used in quantum information processing. Here we propose a high-fidelity and controllable quantum cloning scheme between solid bits and flying bits. In order to overcome the obstacles from the no-cloning theorem and the weak phonon-photon interaction, we introduce a hybrid optomechanical system that performs both the probabilistic cloning and deterministic cloning closed to the theoretical optimal limit with the help of designed driving pulse in the presence of dissipation. In addition, our scheme allows a highly tunable switching between two cloning methods, namely the probabilistic and deterministic cloning, by simply changing the input laser pulse. This provides a promising platform for experimental executability.


title: Partial k-means to avoid outliers, mathematical programming formulations, complexity results

abstract: A well-known bottleneck of Min-Sum-of-Square Clustering (MSSC, the celebrated $k$-means problem) is to tackle the presence of outliers. In this paper, we propose a Partial clustering variant termed PMSSC which considers a fixed number of outliers to remove. We solve PMSSC by Integer Programming formulations and complexity results extending the ones from MSSC are studied. PMSSC is NP-hard in Euclidean space when the dimension or the number of clusters is greater than $2$. Finally, one-dimensional cases are studied: Unweighted PMSSC is polynomial in that case and solved with a dynamic programming algorithm, extending the optimality property of MSSC with interval clustering. This result holds also for unweighted $k$-medoids with outliers. A weaker optimality property holds for weighted PMSSC, but NP-hardness or not remains an open question in dimension one.


title: User Pairing and Power Allocation in Untrusted Multiuser NOMA for Internet-of-Things

abstract: In the Internet-of-Things (IoT), massive sensitive and confidential information is transmitted wirelessly, making security a serious concern. This is particularly true when technologies, such as non-orthogonal multiple access (NOMA), are used, making it possible for users to access each other's data. This paper studies secure communications in multiuser NOMA downlink systems, where each user is potentially an eavesdropper. Resource allocation is formulated to achieve the maximum sum secrecy rate, meanwhile satisfying the users' data requirements and power constraint. We solve this non-trivial, mixed-integer non-linear programming problem by decomposing it into power allocation with a closed-form solution, and user pairing obtained effectively using linear programming relaxation and barrier algorithm. These subproblems are solved iteratively until convergence, with the convergence rate rigorously analyzed. Simulations demonstrate that our approach outperforms its existing alternatives significantly in the sum secrecy rate and computational complexity.


title: Low-energy scatterings and pseudopotential of polarized quadrupoles

abstract: We investigate the low-energy scattering properties of two identical particles interacting via the polarized quadrupolar interaction. It is shown that a series of $s$- and $p$-wave resonances appear for identical bosons and fermions, respectively, as the strength of the quadrupolar interaction increases. Interestingly, scattering resonances also appear on the generalized scattering length corresponding to the coupling between the $s$ and $d$ waves. This observation inspires us to propose a new pseudopotential for the quadupolar interaction. We also explore the bound-state properties of two particles in both free space and harmonic traps.


title: The Kruskal Wallis test can not be recommended

abstract: Although the Kruskal-Wallis (KW) test is widely used, it should not be recommended: it is not robust to arbitrary alternatives, it is only a global test without confidence intervals for the marginal hypotheses, it is inherently defined for two-sided hypotheses, it is not very suitable for pre/post hoc test combinations and hard to modified for factorial designs or the analysis of covariance. As an alternative a double maximum test is proposed: a maximum over multiple contrasts against the grand mean (approximating global power as a linear test statistics) and a maximum over three rank scores, sensitive for location, scale and shape effects. The joint distribution of this new test is achieved by the multiple marginal models approach. Related R-code is provided.


title: Reconfigurable integrated full-dimensional optical lattice generator

abstract: Optical lattices with periodic potentials have attracted great attention in modern optics and photonics, enabling extensive applications in atomic manipulation, optical trapping, optical communications, imaging, sensing, etc. In the last decade, the generation of optical lattices has been widely investigated by various approaches such as multi-plane-wave interferometer, beam superposition, spatial light modulators, nanophotonic circuits, etc. However, all of the previous state-of-the-art works are restricted to only one or two dimensions of the light field, which cannot fulfill the increasing demand on complex light manipulation. Full-dimensional and dynamic control of the light field, including spatial amplitude, phase and polarization, is quite challenging and indispensable for the generation of sophisticated optical lattices. Here, we propose and demonstrate a reconfigurable integrated full-dimensional optical lattice generator, i.e. a photonic emitting array (PEA) enabling reconfigurable and full-dimensional manipulation of optical lattices, in which 4x4 photonic emitting units (PEUs) with 64 thermo-optic microheaters are densely integrated on a silicon chip. By engineering each PEU precisely with independent and complete control of optical properties of amplitude, phase and polarization, various optical vortex lattices, cylindrical vector beam lattices, and vector vortex beam lattices can be generated and reconfigured in the far field. The demonstrated integrated optical lattice generator paves the way for the miniaturization, full-dimensional control and enhanced flexibility of complex light manipulation.


title: Regularity theory for parabolic systems with Uhlenbeck structure

abstract: We establish local regularity theory for parabolic systems of Uhlenbeck type with $\varphi$-growth. In particular, we prove local boundedness of weak solutions and their gradient, and then local H\"older continuity of the gradients, providing suitable assumptions on the growth function $\varphi$. Our approach, being independent of the degeneracy of the system, allows for a unified treatment of both the degenerate and the singular case.


title: SLOTH: Structured Learning and Task-based Optimization for Time Series Forecasting on Hierarchies

abstract: Multivariate time series forecasting with hierarchical structure is widely used in real-world applications, e.g., sales predictions for the geographical hierarchy formed by cities, states, and countries. The hierarchical time series (HTS) forecasting includes two sub-tasks, i.e., forecasting and reconciliation. In the previous works, hierarchical information is only integrated in the reconciliation step to maintain coherency, but not in forecasting step for accuracy improvement. In this paper, we propose two novel tree-based feature integration mechanisms, i.e., top-down convolution and bottom-up attention to leverage the information of the hierarchical structure to improve the forecasting performance. Moreover, unlike most previous reconciliation methods which either rely on strong assumptions or focus on coherent constraints only,we utilize deep neural optimization networks, which not only achieve coherency without any assumptions, but also allow more flexible and realistic constraints to achieve task-based targets, e.g., lower under-estimation penalty and meaningful decision-making loss to facilitate the subsequent downstream tasks. Experiments on real-world datasets demonstrate that our tree-based feature integration mechanism achieves superior performances on hierarchical forecasting tasks compared to the state-of-the-art methods, and our neural optimization networks can be applied to real-world tasks effectively without any additional effort under coherence and task-based constraints


title: On the properness of the moduli space of stable surfaces over $\mathbb{Z}[1/30]$

abstract: We show the properness of the moduli stack of stable surfaces over $\mathbb{Z}[1/30]$, assuming the locally-stable reduction conjecture for stable surfaces. This relies on a local Kawamata--Viehweg vanishing theorem for for 3-dimensional log canonical singularities at closed point of characteristic $p \neq 2, 3$ and $5$ which are not log canonical centres.


title: On Structural and Spectral Properties of Distance Magic Graphs

abstract: A graph $G=(V,E)$ is said to be distance magic if there is a bijection $f$ from a vertex set of $G$ to the first $|V(G)|$ natural numbers such that for each vertex $v$, its weight given by $\sum_{u \in N(v)}f(u)$ is constant, where $N(v)$ is an open neighborhood of a vertex $v$. In this paper, we introduce the concept of $p$-distance magic labeling and establish the necessary and sufficient condition for a graph to be distance magic. Additionally, we introduce necessary and sufficient conditions for a connected regular graph to exhibit distance magic properties in terms of the eigenvalues of its adjacency and Laplacian matrices. Furthermore, we study the spectra of distance magic graphs, focusing on singular distance magic graphs. Also, we show that the number of distance magic labelings of a graph is, at most, the size of its automorphism group.


title: Sharp conditions for the validity of the Bourgain-Brezis-Mironescu formula

abstract: Following the seminal paper by Bourgain, Brezis and Mironescu, we focus on the asymptotic behavior of some nonlocal functionals that, for each $u\in L^2(\mathbb{R}^N)$, are defined as the double integrals of weighted, squared difference quotients of $u$. Given a family of weights $\{\rho_\epsilon\}$, $\epsilon\in (0,1)$, we devise sufficient and necessary conditions on $\{\rho_\epsilon\}$ for the associated nonlocal functionals to converge as $\epsilon\to 0$ to a variant of the Dirichlet integral. Finally, some comparison between our result and the existing literature is provided.


title: Breakdown of self-cleaning mechanism for nanoscale interfacial substances in tiny-angle twisted bilayer graphene

abstract: Realization of high-quality van der Waals (vdW) heterostructures with tailored properties by stacking two-dimensional (2D) layers requires atomically clean interfaces. Because of strong adhesion between the constituent layers, the vdW forces could drive trapped contaminants together into submicron-size bubbles, which leaves large interfacial areas atomically clean. Such a phenomenon is dubbed self-cleaning mechanism in 2D systems. Here, we demonstrate the breakdown of self-cleaning mechanism for nanoscale interfacial bubbles in tiny-angle twisted bilayer graphene (TBG). In the tiny-angle TBG, there is a triangular network of domain boundaries due to structural reconstruction. Our experiments indicate that the bubbles will mainly move along the triangular network of domain boundaries when the sizes of the bubbles are comparable to that of an AA-stacking region in the TBG. When the size of the bubble is smaller than that of an AA-stacking region, the bubble becomes motionless and is fixed in the AA-stacking region because of its large out-of-plane corrugation. Our results reveal a substantial influence of the moir\'e superlattice on the motion of nanoscale interfacial substances.