title: Comparison of Cross-Entropy, Dice, and Focal Loss for Sea Ice Type Segmentation

abstract: Up-to-date sea ice charts are crucial for safer navigation in ice-infested waters. Recently, Convolutional Neural Network (CNN) models show the potential to accelerate the generation of ice maps for large regions. However, results from CNN models still need to undergo scrutiny as higher metrics performance not always translate to adequate outputs. Sea ice type classes are imbalanced, requiring special treatment during training. We evaluate how three different loss functions, some developed for imbalanced class problems, affect the performance of CNN models trained to predict the dominant ice type in Sentinel-1 images. Despite the fact that Dice and Focal loss produce higher metrics, results from cross-entropy seem generally more physically consistent.


title: Core Challenge 2023: Solver and Graph Descriptions

abstract: This paper collects all descriptions of solvers and ISR instances submitted to CoRe Challenge 2023.


title: Large-Scale Gaussian Processes via Alternating Projection

abstract: Training and inference in Gaussian processes (GPs) require solving linear systems with $n\times n$ kernel matrices. To address the prohibitive $\mathcal{O}(n^3)$ time complexity, recent work has employed fast iterative methods, like conjugate gradients (CG). However, as datasets increase in magnitude, the kernel matrices become increasingly ill-conditioned and still require $\mathcal{O}(n^2)$ space without partitioning. Thus, while CG increases the size of datasets GPs can be trained on, modern datasets reach scales beyond its applicability. In this work, we propose an iterative method which only accesses subblocks of the kernel matrix, effectively enabling mini-batching. Our algorithm, based on alternating projection, has $\mathcal{O}(n)$ per-iteration time and space complexity, solving many of the practical challenges of scaling GPs to very large datasets. Theoretically, we prove the method enjoys linear convergence. Empirically, we demonstrate its fast convergence in practice and robustness to ill-conditioning. On large-scale benchmark datasets with up to four million data points, our approach accelerates GP training and inference by speed-up factors up to $27\times$ and $72 \times$, respectively, compared to CG.


title: A Classifier Using Global Character Level and Local Sub-unit Level Features for Hindi Online Handwritten Character Recognition

abstract: A classifier is developed that defines a joint distribution of global character features, number of sub-units and local sub-unit features to model Hindi online handwritten characters. The classifier uses latent variables to model the structure of sub-units. The classifier uses histograms of points, orientations, and dynamics of orientations (HPOD) features to represent characters at global character level and local sub-unit level and is independent of character stroke order and stroke direction variations. The parameters of the classifier is estimated using maximum likelihood method. Different classifiers and features used in other studies are considered in this study for classification performance comparison with the developed classifier. The classifiers considered are Second Order Statistics (SOS), Sub-space (SS), Fisher Discriminant (FD), Feedforward Neural Network (FFN) and Support Vector Machines (SVM) and the features considered are Spatio Temporal (ST), Discrete Fourier Transform (DFT), Discrete Cosine Transform (SCT), Discrete Wavelet Transform (DWT), Spatial (SP) and Histograms of Oriented Gradients (HOG). Hindi character datasets used for training and testing the developed classifier consist of samples of handwritten characters from 96 different character classes. There are 12832 samples with an average of 133 samples per character class in the training set and 2821 samples with an average of 29 samples per character class in the testing set. The developed classifier has the highest accuracy of 93.5\% on the testing set compared to that of the classifiers trained on different features extracted from the same training set and evaluated on the same testing set considered in this study.


title: Understanding and Addressing the Pitfalls of Bisimulation-based Representations in Offline Reinforcement Learning

abstract: While bisimulation-based approaches hold promise for learning robust state representations for Reinforcement Learning (RL) tasks, their efficacy in offline RL tasks has not been up to par. In some instances, their performance has even significantly underperformed alternative methods. We aim to understand why bisimulation methods succeed in online settings, but falter in offline tasks. Our analysis reveals that missing transitions in the dataset are particularly harmful to the bisimulation principle, leading to ineffective estimation. We also shed light on the critical role of reward scaling in bounding the scale of bisimulation measurements and of the value error they induce. Based on these findings, we propose to apply the expectile operator for representation learning to our offline RL setting, which helps to prevent overfitting to incomplete data. Meanwhile, by introducing an appropriate reward scaling strategy, we avoid the risk of feature collapse in representation space. We implement these recommendations on two state-of-the-art bisimulation-based algorithms, MICo and SimSR, and demonstrate performance gains on two benchmark suites: D4RL and Visual D4RL. Codes are provided at \url{https://github.com/zanghyu/Offline_Bisimulation}.


title: Symbolic Planning and Code Generation for Grounded Dialogue

abstract: Large language models (LLMs) excel at processing and generating both text and code. However, LLMs have had limited applicability in grounded task-oriented dialogue as they are difficult to steer toward task objectives and fail to handle novel grounding. We present a modular and interpretable grounded dialogue system that addresses these shortcomings by composing LLMs with a symbolic planner and grounded code execution. Our system consists of a reader and planner: the reader leverages an LLM to convert partner utterances into executable code, calling functions that perform grounding. The translated code's output is stored to track dialogue state, while a symbolic planner determines the next appropriate response. We evaluate our system's performance on the demanding OneCommon dialogue task, involving collaborative reference resolution on abstract images of scattered dots. Our system substantially outperforms the previous state-of-the-art, including improving task success in human evaluations from 56% to 69% in the most challenging setting.


title: Neural style transfer of weak lensing mass maps

abstract: We propose a new generative model of projected cosmic mass density maps inferred from weak gravitational lensing observations of distant galaxies (weak lensing mass maps). We construct the model based on a neural style transfer so that it can transform Gaussian weak lensing mass maps into deeply non-Gaussian counterparts as predicted in ray-tracing lensing simulations. We develop an unpaired image-to-image translation method with Cycle-Consistent Generative Adversarial Networks (Cycle GAN), which learn efficient mapping from an input domain to a target domain. Our model is designed to enjoy important advantages; it is trainable with no need for paired simulation data, flexible to make the input domain visually meaningful, and expandable to rapidly-produce a map with a larger sky coverage than training data without additional learning. Using 10,000 lensing simulations, we find that appropriate labeling of training data based on field variance allows the model to reproduce a correct scatter in summary statistics for weak lensing mass maps. Compared with a popular log-normal model, our model improves in predicting the statistical natures of three-point correlations and local properties of rare high-density regions. We also demonstrate that our model enables us to produce a continuous map with a sky coverage of $\sim166\, \mathrm{deg}^2$ but similar non-Gaussian features to training data covering $\sim12\, \mathrm{deg}^2$ in a GPU minute. Hence, our model can be beneficial to massive productions of synthetic weak lensing mass maps, which is of great importance in future precise real-world analyses.


title: Single channel speech enhancement by colored spectrograms

abstract: Speech enhancement concerns the processes required to remove unwanted background sounds from the target speech to improve its quality and intelligibility. In this paper, a novel approach for single-channel speech enhancement is presented, using colored spectrograms. We propose the use of a deep neural network (DNN) architecture adapted from the pix2pix generative adversarial network (GAN) and train it over colored spectrograms of speech to denoise them. After denoising, the colors of spectrograms are translated to magnitudes of short-time Fourier transform (STFT) using a shallow regression neural network. These estimated STFT magnitudes are later combined with the noisy phases to obtain an enhanced speech. The results show an improvement of almost 0.84 points in the perceptual evaluation of speech quality (PESQ) and 1% in the short-term objective intelligibility (STOI) over the unprocessed noisy data. The gain in quality and intelligibility over the unprocessed signal is almost equal to the gain achieved by the baseline methods used for comparison with the proposed model, but at a much reduced computational cost. The proposed solution offers a comparative PESQ score at almost 10 times reduced computational cost than a similar baseline model that has generated the highest PESQ score trained on grayscaled spectrograms, while it provides only a 1% deficit in STOI at 28 times reduced computational cost when compared to another baseline system based on convolutional neural network-GAN (CNN-GAN) that produces the most intelligible speech.


title: Techniques for supercharging academic writing with generative AI

abstract: Academic writing is an indispensable yet laborious part of the research enterprise. This Perspective maps out principles and methods for using generative artificial intelligence (AI), specifically large language models (LLMs), to elevate the quality and efficiency of academic writing. We introduce a human-AI collaborative framework that delineates the rationale (why), process (how), and nature (what) of AI engagement in writing. The framework pinpoints both short-term and long-term reasons for engagement and their underlying mechanisms (e.g., cognitive offloading and imaginative stimulation). It reveals the role of AI throughout the writing process, conceptualized through a two-stage model for human-AI collaborative writing, and the nature of AI assistance in writing, represented through a model of writing-assistance types and levels. Building on this framework, we describe effective prompting techniques for incorporating AI into the writing routine (outlining, drafting, and editing) as well as strategies for maintaining rigorous scholarship, adhering to varied journal policies, and avoiding overreliance on AI. Ultimately, the prudent integration of AI into academic writing can ease the communication burden, empower authors, accelerate discovery, and promote diversity in science.


title: Some remarks on strong multiplicity one for paramodular forms

abstract: We establish several refined strong multiplicity one results for paramodular cusp forms by using the spinor and standard $L$-functions with the combination of the methods from both of automorphic side and Galois side.


title: Unveiling microstructural damage for leakage current degradation in SiC Schottky diode after heavy ions irradiation under 200 V

abstract: Single-event burnout and single-event leakage current (SELC) in SiC power devices induced by heavy ions severely limit their space application, and the underlying mechanism is still unclear. One fundamental problem is lack of high-resolution characterization of radiation damage in the irradiated SiC power devices, which is a crucial indicator of the related mechanism. In this letter, high-resolution transmission electron microscopy (TEM) was used to characterize the radiation damage in the 1437.6 MeV 181Ta-irradiated SiC junction barrier Schottky diode under 200 V. The amorphous radiation damage with about 52 nm in diameter and 121 nm in length at the Schottky metal (Ti)-semiconductor (SiC) interface was observed. More importantly, in the damage site the atomic mixing of Ti, Si, and C was identified by electron energy loss spectroscopy and high-angle annular dark-field scanning TEM. It indicates that the melting of the Ti-SiC interface induced by localized Joule heating is responsible for the amorphization and the formation of titanium silicide, titanium carbide, or ternary phases. These modifications at nanoscale in turn cause the localized degradation of the Schottky contact, resulting in the permanent increase in leakage current. This experimental study provides very valuable clues to thorough understanding of the SELC mechanism in SiC diode.


title: Counterfactual-Augmented Importance Sampling for Semi-Offline Policy Evaluation

abstract: In applying reinforcement learning (RL) to high-stakes domains, quantitative and qualitative evaluation using observational data can help practitioners understand the generalization performance of new policies. However, this type of off-policy evaluation (OPE) is inherently limited since offline data may not reflect the distribution shifts resulting from the application of new policies. On the other hand, online evaluation by collecting rollouts according to the new policy is often infeasible, as deploying new policies in these domains can be unsafe. In this work, we propose a semi-offline evaluation framework as an intermediate step between offline and online evaluation, where human users provide annotations of unobserved counterfactual trajectories. While tempting to simply augment existing data with such annotations, we show that this naive approach can lead to biased results. Instead, we design a new family of OPE estimators based on importance sampling (IS) and a novel weighting scheme that incorporate counterfactual annotations without introducing additional bias. We analyze the theoretical properties of our approach, showing its potential to reduce both bias and variance compared to standard IS estimators. Our analyses reveal important practical considerations for handling biased, noisy, or missing annotations. In a series of proof-of-concept experiments involving bandits and a healthcare-inspired simulator, we demonstrate that our approach outperforms purely offline IS estimators and is robust to imperfect annotations. Our framework, combined with principled human-centered design of annotation solicitation, can enable the application of RL in high-stakes domains.


title: Simple Baselines for Projection-based Full-reference and No-reference Point Cloud Quality Assessment

abstract: Point clouds are widely used in 3D content representation and have various applications in multimedia. However, compression and simplification processes inevitably result in the loss of quality-aware information under storage and bandwidth constraints. Therefore, there is an increasing need for effective methods to quantify the degree of distortion in point clouds. In this paper, we propose simple baselines for projection-based point cloud quality assessment (PCQA) to tackle this challenge. We use multi-projections obtained via a common cube-like projection process from the point clouds for both full-reference (FR) and no-reference (NR) PCQA tasks. Quality-aware features are extracted with popular vision backbones. The FR quality representation is computed as the similarity between the feature maps of reference and distorted projections while the NR quality representation is obtained by simply squeezing the feature maps of distorted projections with average pooling The corresponding quality representations are regressed into visual quality scores by fully-connected layers. Taking part in the ICIP 2023 PCVQA Challenge, we succeeded in achieving the top spot in four out of the five competition tracks.


abstract: Collective dynamics of many particle systems is tightly linked to their underlying symmetry and phase transitions. Higgs and Nambu-Goldstone modes are, respectively, collective amplitude and phase modes of the order parameter that are widely observed in various physical systems at different energy scales, ranging from magnets, superfluids, superconductors to our universe. The Higgs mode is a massive excitation, which is a condensed-matter analog of Higgs particle in high-energy physics, while the Nambu-Goldstone mode is a massless excitation that appears when a continuous symmetry is spontaneously broken. They provide important information on the fundamental aspects of many particle systems, such as symmetry, phases, dynamics, response to external fields, and so on. In this article, we review the physics of Higgs and Nambu-Goldstone modes in condensed matter physics. Especially, we focus on the development on the study of collective modes in superconductors and cold-atom systems.


abstract: Spatio-temporal graph neural networks (STGNNs) have gained popularity as a powerful tool for effectively modeling spatio-temporal dependencies in diverse real-world urban applications, including intelligent transportation and public safety. However, the black-box nature of STGNNs limits their interpretability, hindering their application in scenarios related to urban resource allocation and policy formulation. To bridge this gap, we propose an Explainable Spatio-Temporal Graph Neural Networks (STExplainer) framework that enhances STGNNs with inherent explainability, enabling them to provide accurate predictions and faithful explanations simultaneously. Our framework integrates a unified spatio-temporal graph attention network with a positional information fusion layer as the STG encoder and decoder, respectively. Furthermore, we propose a structure distillation approach based on the Graph Information Bottleneck (GIB) principle with an explainable objective, which is instantiated by the STG encoder and decoder. Through extensive experiments, we demonstrate that our STExplainer outperforms state-of-the-art baselines in terms of predictive accuracy and explainability metrics (i.e., sparsity and fidelity) on traffic and crime prediction tasks. Furthermore, our model exhibits superior representation ability in alleviating data missing and sparsity issues. The implementation code is available at: https://github.com/HKUDS/STExplainer.


title: Generating a 4-photon Tetrahedron State: Towards Simultaneous Super-sensitivity to Non-commuting Rotations

abstract: It is often thought that the super-sensitivity of a quantum state to an observable comes at the cost of a decreased sensitivity to other non-commuting observables. For example, a squeezed state squeezed in position quadrature is super-sensitive to position displacements, but very insensitive to momentum displacements. This misconception was cleared with the introduction of the compass state, a quantum state equally super-sensitive to displacements in position and momentum. When looking at quantum states used to measure spin rotations, N00N states are known to be more advantageous than classical methods as long as they are aligned to the rotation axis. When considering the estimation of a rotation with unknown direction and amplitude, a certain class of states stands out with interesting properties. These states are equally sensitive to rotations around any axis, are second-order unpolarized, and can possess the rotational properties of platonic solids in particular dimensions. Importantly, these states are optimal for simultaneously estimating the three parameters describing a rotation. In the asymptotic limit, estimating all d parameters describing a transformation simultaneously rather than sequentially can lead to a reduction of the appropriately-weighted sum of the measured parameters' variances by a factor of d. We report the experimental creation and characterization of the lowest-dimensional such state, which we call the "tetrahedron state" due to its tetrahedral symmetry. This tetrahedron state is created in the symmetric subspace of four optical photons' polarization in a single spatial and temporal mode, which behaves as a spin-2 particle. While imperfections due to the hardware limit the performance of our method, we argue that better technology can improve our method to the point of outperforming any other existing strategy in per-photon comparisons.


title: A Non-Hausdorff de Rham Cohomology

abstract: In this paper we introduce and study the basic properties of de Rham cohomology for a certain class of non-Hausdorff manifolds. After a careful discussion of non-Hausdorff differential forms, we provide a description of de Rham cohomology via Mayer-Vietoris sequences. We then use these sequences to prove both de Rham's Theorem and the Gauss-Bonnet theorem for our non-Hausdorff manifolds. Regarding the latter, we will see that the desired equality requires additional counterterms coming from the geodesic curvature of certain Hausdorff-violating submanifolds.


title: Technical Note: Feasibility of translating 3.0T-trained Deep-Learning Segmentation Models Out-of-the-Box on Low-Field MRI 0.55T Knee-MRI of Healthy Controls

abstract: In the current study, our purpose is to evaluate the feasibility of applying deep learning (DL) enabled algorithms to quantify bilateral knee biomarkers in healthy controls scanned at 0.55T and compared with 3.0T. The current study assesses the performance of standard in-practice bone, and cartilage segmentation algorithms at 0.55T, both qualitatively and quantitatively, in terms of comparing segmentation performance, areas of improvement, and compartment-wise cartilage thickness values between 0.55T vs. 3.0T. Initial results demonstrate a usable to good technical feasibility of translating existing quantitative deep-learning-based image segmentation techniques, trained on 3.0T, out of 0.55T for knee MRI, in a multi-vendor acquisition environment. Especially in terms of segmenting cartilage compartments, the models perform almost equivalent to 3.0T in terms of Likert ranking. The 0.55T low-field sustainable and easy-to-install MRI, as demonstrated, thus, can be utilized for evaluating knee cartilage thickness and bone segmentations aided by established DL algorithms trained at higher-field strengths out-of-the-box initially. This could be utilized at the far-spread point-of-care locations with a lack of radiologists available to manually segment low-field images, at least till a decent base of low-field data pool is collated. With further fine-tuning with manual labeling of low-field data or utilizing synthesized higher SNR images from low-field images, OA biomarker quantification performance is potentially guaranteed to be further improved.


title: Hierarchical Semi-Implicit Variational Inference with Application to Diffusion Model Acceleration

abstract: Semi-implicit variational inference (SIVI) has been introduced to expand the analytical variational families by defining expressive semi-implicit distributions in a hierarchical manner. However, the single-layer architecture commonly used in current SIVI methods can be insufficient when the target posterior has complicated structures. In this paper, we propose hierarchical semi-implicit variational inference, called HSIVI, which generalizes SIVI to allow more expressive multi-layer construction of semi-implicit distributions. By introducing auxiliary distributions that interpolate between a simple base distribution and the target distribution, the conditional layers can be trained by progressively matching these auxiliary distributions one layer after another. Moreover, given pre-trained score networks, HSIVI can be used to accelerate the sampling process of diffusion models with the score matching objective. We show that HSIVI significantly enhances the expressiveness of SIVI on several Bayesian inference problems with complicated target distributions. When used for diffusion model acceleration, we show that HSIVI can produce high quality samples comparable to or better than the existing fast diffusion model based samplers with a small number of function evaluations on various datasets.


title: Deep Imbalanced Regression via Hierarchical Classification Adjustment

abstract: Regression tasks in computer vision, such as age estimation or counting, are often formulated into classification by quantizing the target space into classes. Yet real-world data is often imbalanced -- the majority of training samples lie in a head range of target values, while a minority of samples span a usually larger tail range. By selecting the class quantization, one can adjust imbalanced regression targets into balanced classification outputs, though there are trade-offs in balancing classification accuracy and quantization error. To improve regression performance over the entire range of data, we propose to construct hierarchical classifiers for solving imbalanced regression tasks. The fine-grained classifiers limit the quantization error while being modulated by the coarse predictions to ensure high accuracy. Standard hierarchical classification approaches, however, when applied to the regression problem, fail to ensure that predicted ranges remain consistent across the hierarchy. As such, we propose a range-preserving distillation process that can effectively learn a single classifier from the set of hierarchical classifiers. Our novel hierarchical classification adjustment (HCA) for imbalanced regression shows superior results on three diverse tasks: age estimation, crowd counting and depth estimation. We will release the source code upon acceptance.


title: Max-min Rate Optimization of Low-Complexity Hybrid Multi-User Beamforming Maintaining Rate-Fairness

abstract: A wireless network serving multiple users in the millimeter-wave or the sub-terahertz band by a base station is considered. High-throughput multi-user hybrid-transmit beamforming is conceived by maximizing the minimum rate of the users. For the sake of energy-efficient signal transmission, the array-of-subarrays structure is used for analog beamforming relying on low-resolution phase shifters. We develop a convexsolver based algorithm, which iteratively invokes a convex problem of the same beamformer size for its solution. We then introduce the soft max-min rate objective function and develop a scalable algorithm for its optimization. Our simulation results demonstrate the striking fact that soft max-min rate optimization not only approaches the minimum user rate obtained by max-min rate optimization but it also achieves a sum rate similar to that of sum-rate maximization. Thus, the soft max-min rate optimization based beamforming design conceived offers a new technique of simultaneously achieving a high individual quality-of-service for all users and a high total network throughput.


title: Learning depth from monocular video sequences

abstract: Learning single image depth estimation model from monocular video sequence is a very challenging problem. In this paper, we propose a novel training loss which enables us to include more images for supervision during the training process. We propose a simple yet effective model to account the frame to frame pixel motion. We also design a novel network architecture for single image estimation. When combined, our method produces state of the art results for monocular depth estimation on the KITTI dataset in the self-supervised setting.


title: Deja Vu: Contextual Sparsity for Efficient LLMs at Inference Time

abstract: Large language models (LLMs) with hundreds of billions of parameters have sparked a new wave of exciting AI applications. However, they are computationally expensive at inference time. Sparsity is a natural approach to reduce this cost, but existing methods either require costly retraining, have to forgo LLM's in-context learning ability, or do not yield wall-clock time speedup on modern hardware. We hypothesize that contextual sparsity, which are small, input-dependent sets of attention heads and MLP parameters that yield approximately the same output as the dense model for a given input, can address these issues. We show that contextual sparsity exists, that it can be accurately predicted, and that we can exploit it to speed up LLM inference in wall-clock time without compromising LLM's quality or in-context learning ability. Based on these insights, we propose DejaVu, a system that uses a low-cost algorithm to predict contextual sparsity on the fly given inputs to each layer, along with an asynchronous and hardware-aware implementation that speeds up LLM inference. We validate that DejaVu can reduce the inference latency of OPT-175B by over 2X compared to the state-of-the-art FasterTransformer, and over 6X compared to the widely used Hugging Face implementation, without compromising model quality. The code is available at https://github.com/FMInference/DejaVu.


title: CosmosDSR -- a methodology for automated detection and tracking of orbital debris using the Unscented Kalman Filter

abstract: The Kessler syndrome refers to the escalating space debris from frequent space activities, threatening future space exploration. Addressing this issue is vital. Several AI models, including Convolutional Neural Networks, Kernel Principal Component Analysis, and Model-Agnostic Meta- Learning have been assessed with various data types. Earlier studies highlighted the combination of the YOLO object detector and a linear Kalman filter (LKF) for object detection and tracking. Advancing this, the current paper introduces a novel methodology for the Comprehensive Orbital Surveillance and Monitoring Of Space by Detecting Satellite Residuals (CosmosDSR) by combining YOLOv3 with an Unscented Kalman Filter (UKF) for tracking satellites in sequential images. Using the Spacecraft Recognition Leveraging Knowledge of Space Environment (SPARK) dataset for training and testing, the YOLOv3 precisely detected and classified all satellite categories (Mean Average Precision=97.18%, F1=0.95) with few errors (TP=4163, FP=209, FN=237). Both CosmosDSR and an implemented LKF used for comparison tracked satellites accurately for a mean squared error (MSE) and root mean squared error (RME) of MSE=2.83/RMSE=1.66 for UKF and MSE=2.84/RMSE=1.66 for LKF. The current study is limited to images generated in a space simulation environment, but the CosmosDSR methodology shows great potential in detecting and tracking satellites, paving the way for solutions to the Kessler syndrome.


title: MaxEnt Loss: Constrained Maximum Entropy for Calibration under Out-of-Distribution Shift

abstract: We present a new loss function that addresses the out-of-distribution (OOD) calibration problem. While many objective functions have been proposed to effectively calibrate models in-distribution, our findings show that they do not always fare well OOD. Based on the Principle of Maximum Entropy, we incorporate helpful statistical constraints observed during training, delivering better model calibration without sacrificing accuracy. We provide theoretical analysis and show empirically that our method works well in practice, achieving state-of-the-art calibration on both synthetic and real-world benchmarks.


title: Long-coherence pairing of low-mass conduction electrons in copper-substituted lead apatite

abstract: Two entangled qubits emerge as an essential resource for quantum control, which are normally quantum confined with atomic precision. It seems inhibitive that in the macroscopic scope collective qubit pairs manifest long coherence and quantum entanglement, especially at high temperature. Here, we report this exotic ensemble effect in solid-state sintering lead apatite samples with copper substitution, which have been repeatedly duplicated with superior stability and low cost. An extraordinarily low-field absorption signal of cw electron paramagnetic resonance (EPR) spectroscopy stems from low-mass conduction electrons implying the coherence of cuprate radicals can be long-termly protected. The pulsed EPR experiments exhibit triplet Rabi oscillation from paired cuprate diradicals with the coherence time exceeding 1 microsecond at 85K. We believe these appealing effects are sufficiently promising to be applied for scalable quantum control and computation.


title: Structure discovery in Atomic Force Microscopy imaging of ice

abstract: The interaction of water with surfaces is crucially important in a wide range of natural and technological settings. In particular, at low temperatures, unveiling the atomistic structure of adsorbed water clusters would provide valuable data for understanding the ice nucleation process. Using high-resolution Atomic Force Microscopy (AFM) and Scanning Tunnelling Microscopy, several studies have demonstrated the presence of water pentamers, hexamers, heptamers (and of their combinations) on a variety of metallic surfaces, as well the initial stages of 2D ice growth on an insulating surface. However, in all these cases, the observed structures were completely flat, providing a relatively straightforward path to interpretation. Here, we present high-resolution AFM measurements of several new water clusters on Au(111) and Cu(111), whose understanding presents significant challenges, due to both their highly 3D configuration and to their large size. For each of them, we use a combination of machine learning, atomistic modelling with neural network potentials and statistical sampling to propose an underlying atomic structure, finally comparing its AFM simulated images to the experimental ones. These results provide new insights into the early phases of ice formation, which is a ubiquitous phenomenon ranging from biology to astrophysics.


title: Content-based Controls For Music Large Language Modeling

abstract: Recent years have witnessed a rapid growth of large-scale language models in the domain of music audio. Such models enable end-to-end generation of higher-quality music, and some allow conditioned generation using text descriptions. However, the control power of text controls on music is intrinsically limited, as they can only describe music indirectly through meta-data (such as singers and instruments) or high-level representations (such as genre and emotion). We aim to further equip the models with direct and content-based controls on innate music languages such as pitch, chords and drum track. To this end, we contribute Coco-Mulla, a content-based control method for music large language modeling. It uses a parameter-efficient fine-tuning (PEFT) method tailored for Transformer-based audio models. Experiments show that our approach achieved high-quality music generation with low-resource semi-supervised learning, tuning with less than 4% parameters compared to the original model and training on a small dataset with fewer than 300 songs. Moreover, our approach enables effective content-based controls, and we illustrate the control power via chords and rhythms, two of the most salient features of music audio. Furthermore, we show that by combining content-based controls and text descriptions, our system achieves flexible music variation generation and arrangement. Our source codes and demos are available online.


title: Low-Dimensional Gradient Helps Out-of-Distribution Detection

abstract: Detecting out-of-distribution (OOD) samples is essential for ensuring the reliability of deep neural networks (DNNs) in real-world scenarios. While previous research has predominantly investigated the disparity between in-distribution (ID) and OOD data through forward information analysis, the discrepancy in parameter gradients during the backward process of DNNs has received insufficient attention. Existing studies on gradient disparities mainly focus on the utilization of gradient norms, neglecting the wealth of information embedded in gradient directions. To bridge this gap, in this paper, we conduct a comprehensive investigation into leveraging the entirety of gradient information for OOD detection. The primary challenge arises from the high dimensionality of gradients due to the large number of network parameters. To solve this problem, we propose performing linear dimension reduction on the gradient using a designated subspace that comprises principal components. This innovative technique enables us to obtain a low-dimensional representation of the gradient with minimal information loss. Subsequently, by integrating the reduced gradient with various existing detection score functions, our approach demonstrates superior performance across a wide range of detection tasks. For instance, on the ImageNet benchmark, our method achieves an average reduction of 11.15% in the false positive rate at 95% recall (FPR95) compared to the current state-of-the-art approach. The code would be released.


title: Bridging Phylogeny and Taxonomy with Protein-protein Interaction Networks

abstract: The protein-protein interaction (PPI) network provides an overview of the complex biological reactions vital to an organism's metabolism and survival. Even though in the past PPI network were compared across organisms in detail, there has not been large-scale research on how individual PPI networks reflect on the species relationships. In this study we aim to increase our understanding of the tree of life and taxonomy by gleaming information from the PPI networks. We successful created (1) a predictor of network statistics based on known traits of existing species in the phylogeny, and (2) a taxonomic classifier of organism using the known protein network statistics, whether experimentally determined or predicted de novo. With the knowledge of protein interactions at its core, our two models effectively connects two field with widely diverging methodologies - the phylogeny and taxonomy of species.


title: Price Experimentation and Interference

abstract: In this paper, we examine biases arising in A/B tests where firms modify a continuous parameter, such as price, to estimate the global treatment effect of a given performance metric, such as profit. These biases emerge in canonical experimental estimators due to interference among market participants. We employ structural modeling and differential calculus to derive intuitive characterizations of these biases. We then specialize our general model to a standard revenue management pricing problem. This setting highlights a key pitfall in the use of A/B pricing experiments to guide profit maximization: notably, the canonical estimator for the expected change in profits can have the {\em wrong sign}. In other words, following the guidance of canonical estimators may lead firms to move prices in the wrong direction, inadvertently decreasing profits relative to the status quo. We apply these results to a two-sided market model and show how this ``change of sign" regime depends on model parameters such as market imbalance, as well as the price markup. Finally, we discuss structural and practical implications for platform operators.


title: X-SNS: Cross-Lingual Transfer Prediction through Sub-Network Similarity

abstract: Cross-lingual transfer (XLT) is an emergent ability of multilingual language models that preserves their performance on a task to a significant extent when evaluated in languages that were not included in the fine-tuning process. While English, due to its widespread usage, is typically regarded as the primary language for model adaption in various tasks, recent studies have revealed that the efficacy of XLT can be amplified by selecting the most appropriate source languages based on specific conditions. In this work, we propose the utilization of sub-network similarity between two languages as a proxy for predicting the compatibility of the languages in the context of XLT. Our approach is model-oriented, better reflecting the inner workings of foundation models. In addition, it requires only a moderate amount of raw text from candidate languages, distinguishing it from the majority of previous methods that rely on external resources. In experiments, we demonstrate that our method is more effective than baselines across diverse tasks. Specifically, it shows proficiency in ranking candidates for zero-shot XLT, achieving an improvement of 4.6% on average in terms of NDCG@3. We also provide extensive analyses that confirm the utility of sub-networks for XLT prediction.


title: Improving Denoising Diffusion Models via Simultaneous Estimation of Image and Noise

abstract: This paper introduces two key contributions aimed at improving the speed and quality of images generated through inverse diffusion processes. The first contribution involves reparameterizing the diffusion process in terms of the angle on a quarter-circular arc between the image and noise, specifically setting the conventional $\displaystyle \sqrt{\bar{\alpha}}=\cos(\eta)$. This reparameterization eliminates two singularities and allows for the expression of diffusion evolution as a well-behaved ordinary differential equation (ODE). In turn, this allows higher order ODE solvers such as Runge-Kutta methods to be used effectively. The second contribution is to directly estimate both the image ($\mathbf{x}_0$) and noise ($\mathbf{\epsilon}$) using our network, which enables more stable calculations of the update step in the inverse diffusion steps, as accurate estimation of both the image and noise are crucial at different stages of the process. Together with these changes, our model achieves faster generation, with the ability to converge on high-quality images more quickly, and higher quality of the generated images, as measured by metrics such as Frechet Inception Distance (FID), spatial Frechet Inception Distance (sFID), precision, and recall.


title: Learning an Inventory Control Policy with General Inventory Arrival Dynamics

abstract: In this paper we address the problem of learning and backtesting inventory control policies in the presence of general arrival dynamics -- which we term as a quantity-over-time arrivals model (QOT). We also allow for order quantities to be modified as a post-processing step to meet vendor constraints such as order minimum and batch size constraints -- a common practice in real supply chains. To the best of our knowledge this is the first work to handle either arbitrary arrival dynamics or an arbitrary downstream post-processing of order quantities. Building upon recent work (Madeka et al., 2022) we similarly formulate the periodic review inventory control problem as an exogenous decision process, where most of the state is outside the control of the agent. Madeka et al., 2022 show how to construct a simulator that replays historic data to solve this class of problem. In our case, we incorporate a deep generative model for the arrivals process as part of the history replay. By formulating the problem as an exogenous decision process, we can apply results from Madeka et al., 2022 to obtain a reduction to supervised learning. Via simulation studies we show that this approach yields statistically significant improvements in profitability over production baselines. Using data from a real-world A/B test, we show that Gen-QOT generalizes well to off-policy data and that the resulting buying policy outperforms traditional inventory management systems in real world settings.


title: A Bivariate Spline based Collocation Method for Numerical Solution to Optimal Transport Problem

abstract: In this paper, we study a spline collocation method for a numerical solution to the optimal transport problem We mainly solve the \MAE with the second boundary condition numerically by proposing a center matching algorithm. We prove a pointwise convergence of our iterative algorithm under the assumption the boundedness of spline iterates. We use the \MAE with Dirichlet boundary condition and some known solutions to the \MAE with second boundary condition to demonstrate the effectiveness of our algorithm. Then we use our method to solve some real-life problems. One application problem is to use the optimal transportation for the conversion of fisheye view images into standard rectangular images.


title: DecoderTracker: Decoder-Only Method for Multiple-Object Tracking

abstract: Decoder-only models, such as GPT, have demonstrated superior performance in many areas compared to traditional encoder-decoder structure transformer models. Over the years, end-to-end models based on the traditional transformer structure, like MOTR, have achieved remarkable performance in multi-object tracking. However, the significant computational resource consumption of these models leads to less friendly inference speeds and training times. To address these issues, this paper attempts to construct a lightweight Decoder-only model: DecoderTracker for end-to-end multi-object tracking. Specifically, drawing on some real-time detection models, we have developed an image feature extraction network which can efficiently extract features from images to replace the encoder structure. In addition to minor innovations in the network, we analyze the potential reasons for the slow training of MOTR-like models and propose an effective training strategy to mitigate the issue of prolonged training times. On the DanceTrack dataset, without any bells and whistles, DecoderTracker's tracking performance slightly surpasses that of MOTR, with approximately twice the inference speed. Furthermore, DecoderTracker requires significantly less training time compared to MOTR.


title: Estimating True Beliefs in Opinion Dynamics with Social Pressure

abstract: Social networks often exert social pressure, causing individuals to adapt their expressed opinions to conform to their peers. An agent in such systems can be modeled as having a (true and unchanging) inherent belief while broadcasting a declared opinion at each time step based on her inherent belief and the past declared opinions of her neighbors. An important question in this setting is parameter estimation: how to disentangle the effects of social pressure to estimate inherent beliefs from declared opinions. This is useful for forecasting when agents' declared opinions are influenced by social pressure while real-world behavior only depends on their inherent beliefs. To address this, Jadbabaie et al. formulated the Interacting P\'olya Urn model of opinion dynamics under social pressure and studied it on complete-graph social networks using an aggregate estimator, and found that their estimator converges to the inherent beliefs unless majority pressure pushes the network to consensus. In this work, we studythis model on arbitrary networks, providing an estimator which converges to the inherent beliefs even in consensus situations. Finally, we bound the convergence rate of our estimator in both consensus and non-consensus scenarios; to get the bound for consensus scenarios (which converge slower than non-consensus) we additionally found how quickly the system converges to consensus.


title: Integrating Subsystem Embedding Subalgebras and Coupled Cluster Green's Function: A Theoretical Foundation for Quantum Embedding in Excitation Manifold

abstract: In this study, we introduce a novel approach to coupled-cluster Green's function (CCGF) embedding by seamlessly integrating conventional CCGF theory with the state-of-the-art sub-system embedding sub-algebras coupled cluster (SES-CC) formalism. This integration focuses primarily on delineating the characteristics of the sub-system and the corresponding segments of the Green's function, defined explicitly by active orbitals. Crucially, our work involves the adaptation of the SES-CC paradigm, addressing the left eigenvalue problem through a distinct form of Hamiltonian similarity transformation. This advancement not only facilitates a comprehensive representation of the interaction between the embedded sub-system and its surrounding environment but also paves the way for the quantum mechanical description of multiple embedded domains, particularly by employing the emergent quantum flow algorithms. Our theoretical underpinnings further set the stage for a generalization to multiple embedded sub-systems. This expansion holds significant promise for the exploration and application of non-equilibrium quantum systems, enhancing the understanding of system-environment interactions. In doing so, the research underscores the potential of SES-CC embedding within the realm of quantum computations and multi-scale simulations, promising a good balance between accuracy and computational efficiency.


title: DSAC-C: Constrained Maximum Entropy for Robust Discrete Soft-Actor Critic

abstract: We present a novel extension to the family of Soft Actor-Critic (SAC) algorithms. We argue that based on the Maximum Entropy Principle, discrete SAC can be further improved via additional statistical constraints derived from a surrogate critic policy. Furthermore, our findings suggests that these constraints provide an added robustness against potential domain shifts, which are essential for safe deployment of reinforcement learning agents in the real-world. We provide theoretical analysis and show empirical results on low data regimes for both in-distribution and out-of-distribution variants of Atari 2600 games.


title: Steady-state charging of quantum batteries via dissipative ancillas

abstract: We investigate the steady-state charging process of a single-cell quantum battery embedded in an N-cell star network of qubits, each interacting with a fermion reservoir, collectively and individually in equilibrium and non-equilibrium scenarios, respectively. We find an optimal steady-state charging in both scenarios, which grows monotonically with the reservoirs' chemical potential and chemical potential difference. Where the high base temperature of the reservoirs has a destructive role in all parameter regimes. We indicate that regardless of the strength of the non-equilibrium condition, the high base chemical potential of the battery's corresponding reservoir can significantly enhance the charging process. On the other hand, a weak coupling strength can strongly suppress the charging. Consequently, our results could counteract the detrimental effects of self-discharging and provide valuable guidelines for enhancing the stable charging of open quantum batteries in the absence of an external charging field.


title: Interaction of liquid crystals with a rigid body

abstract: This article investigates the interaction of nematic liquid crystals modeled by a simplified Ericksen-Leslie model with a rigid body. It is shown that this problem is locally strongly well-posed, and that it also admits a unique, global strong solution for initial data close to constant equilibria. The proof of the global strong solution relies on a new splitting method for the director in a mean value zero and average part.


title: A Deep Learning Approach to Teeth Segmentation and Orientation from Panoramic X-rays

abstract: Accurate teeth segmentation and orientation are fundamental in modern oral healthcare, enabling precise diagnosis, treatment planning, and dental implant design. In this study, we present a comprehensive approach to teeth segmentation and orientation from panoramic X-ray images, leveraging deep learning techniques. We build our model based on FUSegNet, a popular model originally developed for wound segmentation, and introduce modifications by incorporating grid-based attention gates into the skip connections. We introduce oriented bounding box (OBB) generation through principal component analysis (PCA) for precise tooth orientation estimation. Evaluating our approach on the publicly available DNS dataset, comprising 543 panoramic X-ray images, we achieve the highest Intersection-over-Union (IoU) score of 82.43% and Dice Similarity Coefficient (DSC) score of 90.37% among compared models in teeth instance segmentation. In OBB analysis, we obtain the Rotated IoU (RIoU) score of 82.82%. We also conduct detailed analyses of individual tooth labels and categorical performance, shedding light on strengths and weaknesses. The proposed model's accuracy and versatility offer promising prospects for improving dental diagnoses, treatment planning, and personalized healthcare in the oral domain. Our generated OBB coordinates and codes are available at https://github.com/mrinal054/Instance_teeth_segmentation.


title: Bridging The Gaps Between Token Pruning and Full Pre-training via Masked Fine-tuning

abstract: Despite the success of transformers on various computer vision tasks, they suffer from excessive memory and computational cost. Some works present dynamic vision transformers to accelerate inference by pruning redundant tokens. A key to improving token pruning is using well-trained models as initialization for faster convergence and better performance. However, current base models usually adopt full image training, i.e., using full images as inputs and keeping the whole feature maps through the forward process, which causes inconsistencies with dynamic models that gradually reduce tokens, including calculation pattern, information amount and token selection strategy inconsistencies. Inspired by MAE which performs masking and reconstruction self-supervised task, we devise masked fine-tuning to bridge the gaps between pre-trained base models used for initialization and token pruning based dynamic vision transformers, by masking image patches and predicting the image class label based on left unmasked patches. Extensive experiments on ImageNet demonstrate that base models via masked fine-tuning gain strong occlusion robustness and ability against information loss. With this better initialization, Dynamic ViT achieves higher accuracies, especially under large token pruning ratios (e.g., 81.9% vs. 81.3%, and 62.3% vs. 58.9% for DeiT based Dynamic ViT/0.8 and Dynamic ViT/0.3). Moreover, we apply our method into different token pruning based dynamic vision transformers, different pre-trained models and randomly initialized models to demonstrate the generalization ability.


title: Graphical Object-Centric Actor-Critic

abstract: There have recently been significant advances in the problem of unsupervised object-centric representation learning and its application to downstream tasks. The latest works support the argument that employing disentangled object representations in image-based object-centric reinforcement learning tasks facilitates policy learning. We propose a novel object-centric reinforcement learning algorithm combining actor-critic and model-based approaches to utilize these representations effectively. In our approach, we use a transformer encoder to extract object representations and graph neural networks to approximate the dynamics of an environment. The proposed method fills a research gap in developing efficient object-centric world models for reinforcement learning settings that can be used for environments with discrete or continuous action spaces. Our algorithm performs better in a visually complex 3D robotic environment and a 2D environment with compositional structure than the state-of-the-art model-free actor-critic algorithm built upon transformer architecture and the state-of-the-art monolithic model-based algorithm.


title: Linking intra- and extra-cellular metabolic domains via neural-network surrogates for dynamic metabolic control

abstract: We outline a modeling and optimization strategy for investigating dynamic metabolic engineering interventions. Our framework is particularly useful at the early stages of research and development, often constrained by limited knowledge and experimental data. Elucidating a priori optimal trajectories of manipulatable intracellular fluxes can guide the design of suitable control schemes, e.g., cyber(ge)netic or in-cell approaches, and the selection of appropriate actuators, e.g., at the transcriptional or post-translational levels. Model-based dynamic optimization is proposed to predict optimal trajectories of target manipulatable intracellular fluxes. A challenge emerges as existing models are often oversimplified, lacking insights into metabolism, or excessively complex, making them difficult to build and implement. Here, we use surrogates derived from steady-state solutions of constraint-based metabolic models to link manipulatable intracellular fluxes to the process exchange rates of structurally simple hybrid dynamic models. The latter can be conveniently used in optimal control problems of metabolism. As a proof of concept, we apply our method to a reduced metabolic network of $\textit{Escherichia coli}$ considering two different scenarios of dynamic metabolic engineering.


title: A Forward Reachability Perspective on Robust Control Invariance and Discount Factors in Reachability Analysis

abstract: Control invariant sets are crucial for various methods that aim to design safe control policies for systems whose state constraints must be satisfied over an indefinite time horizon. In this article, we explore the connections among reachability, control invariance, and Control Barrier Functions (CBFs) by examining the forward reachability problem associated with control invariant sets. We present the notion of an "inevitable Forward Reachable Tube" (FRT) as a tool for analyzing control invariant sets. Our findings show that the inevitable FRT of a robust control invariant set with a differentiable boundary is the set itself. We highlight the role of the differentiability of the boundary in shaping the FRTs of the sets through numerical examples. We also formulate a zero-sum differential game between the control and disturbance, where the inevitable FRT is characterized by the zero-superlevel set of the value function. By incorporating a discount factor in the cost function of the game, the barrier constraint of the CBF naturally arises as the constraint that is imposed on the optimal control policy. As a result, the value function of our FRT formulation serves as a CBF-like function, which has not been previously realized in reachability studies. Conversely, any valid CBF is also a forward reachability value function inside the control invariant set, thereby revealing the inverse optimality of the CBF. As such, our work establishes a strong link between reachability, control invariance, and CBFs, filling a gap that prior formulations based on backward reachability were unable to bridge.


title: On the shock wave boundary layer interaction in slightly-rarefied gas

abstract: The shock wave and boundary layer interaction (SWBLI) plays an important role in the design of hypersonic vehicles. However, discrepancies between the numerical results of high-temperature gas dynamics and experiment data have not been fully addressed. It is believed that the rarefaction effects are important in SWBLI, but the systematic analysis of the temperature-jump boundary conditions and the role of translational/rotational/vibrational heat conductivities are lacking. In this paper, we derive the three-temperature Navier-Stokes-Fourier (NSF) equations from the gas kinetic theory, with special attention paid to the components of heat conductivity. With proper temperature-jump boundary conditions, we simulate the SWBLI in the double cone experiment. Our numerical results show that, when the three heat conductivities are properly recovered, the NSF equations can capture the position and peak value of the surface heat flux, in both low- and high-enthalpy inflow conditions. Moreover, the separation bubble induced by the separated shock and the reattachment point induced by impact between transmitted shock and boundary layer are found to agree with the experimental measurement.


title: On existence and uniqueness properties for solutions of stochastic fixed point equations with gradient-dependent nonlinearities

abstract: The combination of the It\^o formula and the Bismut-Elworthy-Li formula implies that suitable smooth solutions of semilinear Kolmogorov partial differential equations (PDEs) are also solutions to certain stochastic fixed point equations (SFPEs). In this paper we generalize known results on existence and uniqueness of solutions of SFPEs associated with PDEs with Lipschitz continuous, gradient-independent nonlinearities to the case of gradient-dependent nonlinearities. The main challenge arises from the fact that in the case of a non-differentiable terminal condition and a gradient-dependent nonlinearity the Bismut-Elworthy-Li formula leads to a singularity of the solution of the SFPE in the last time point.


title: Understanding the Effects of Projectors in Knowledge Distillation

abstract: Conventionally, during the knowledge distillation process (e.g. feature distillation), an additional projector is often required to perform feature transformation due to the dimension mismatch between the teacher and the student networks. Interestingly, we discovered that even if the student and the teacher have the same feature dimensions, adding a projector still helps to improve the distillation performance. In addition, projectors even improve logit distillation if we add them to the architecture too. Inspired by these surprising findings and the general lack of understanding of the projectors in the knowledge distillation process from existing literature, this paper investigates the implicit role that projectors play but so far have been overlooked. Our empirical study shows that the student with a projector (1) obtains a better trade-off between the training accuracy and the testing accuracy compared to the student without a projector when it has the same feature dimensions as the teacher, (2) better preserves its similarity to the teacher beyond shallow and numeric resemblance, from the view of Centered Kernel Alignment (CKA), and (3) avoids being over-confident as the teacher does at the testing phase. Motivated by the positive effects of projectors, we propose a projector ensemble-based feature distillation method to further improve distillation performance. Despite the simplicity of the proposed strategy, empirical results from the evaluation of classification tasks on benchmark datasets demonstrate the superior classification performance of our method on a broad range of teacher-student pairs and verify from the aspects of CKA and model calibration that the student's features are of improved quality with the projector ensemble design.


title: Multifunctional imaging enabled by optical bound states in the continuum with broken symmetry

abstract: For photonic crystal slab (PCS) structures, bound states in the continuum (BICs) and circularly polarized states (dubbed C-points) are important topological polarization singularities in momentum-space and have attracted burgeoning attention due to their novel topological and optical properties. In our work, the evolution of polarization singularities from BICs to C-points is achieved by breaking the in-plane C2 symmetry of a PCS structure of a square lattice with C4v symmetry. Correspondingly, a BIC is split into two C-points with opposite chirality, incurring distinct optical transmission responses with the incidence of right or left circular polarization (RCP or LCP). Harnessing such chirality selectivity of the C-points, we propose a multifunctional imaging system by integrating the designed PCS into a conventional 4-f imaging system, to realize both the edge imaging and conventional bright-field imaging, determined by the circular polarization state of the light source. In addition to multifunctional imaging, our system also provides a vivid picture about the evolution of the PCS platforms' singularities.


title: Adaptive importance sampling for Deep Ritz

abstract: We introduce an adaptive sampling method for the Deep Ritz method aimed at solving partial differential equations (PDEs). Two deep neural networks are used. One network is employed to approximate the solution of PDEs, while the other one is a deep generative model used to generate new collocation points to refine the training set. The adaptive sampling procedure consists of two main steps. The first step is solving the PDEs using the Deep Ritz method by minimizing an associated variational loss discretized by the collocation points in the training set. The second step involves generating a new training set, which is then used in subsequent computations to further improve the accuracy of the current approximate solution. We treat the integrand in the variational loss as an unnormalized probability density function (PDF) and approximate it using a deep generative model called bounded KRnet. The new samples and their associated PDF values are obtained from the bounded KRnet. With these new samples and their associated PDF values, the variational loss can be approximated more accurately by importance sampling. Compared to the original Deep Ritz method, the proposed adaptive method improves accuracy, especially for problems characterized by low regularity and high dimensionality. We demonstrate the effectiveness of our new method through a series of numerical experiments.


title: Demystifying Compiler Unstable Feature Usage and Impacts in the Rust Ecosystem

abstract: Rust programming language is gaining popularity rapidly in building reliable and secure systems due to its security guarantees and outstanding performance. To provide extra functionalities, the Rust compiler introduces Rust unstable features (RUF) to extend compiler functionality, syntax, and standard library support. However, these features are unstable and may get removed, introducing compilation failures to dependent packages. Even worse, their impacts propagate through transitive dependencies, causing large-scale failures in the whole ecosystem. Although RUF is widely used in Rust, previous research has primarily concentrated on Rust code safety, with the usage and impacts of RUF from the Rust compiler remaining unexplored. Therefore, we aim to bridge this gap by systematically analyzing the RUF usage and impacts in the Rust ecosystem. We propose novel techniques for extracting RUF precisely, and to assess its impact on the entire ecosystem quantitatively, we accurately resolve package dependencies. We have analyzed the whole Rust ecosystem with 590K package versions and 140M transitive dependencies. Our study shows that the Rust ecosystem uses 1000 different RUF, and at most 44% of package versions are affected by RUF, causing compiling failures for at most 12%. To mitigate wide RUF impacts, we further design and implement a RUF-compilation-failure recovery tool that can recover up to 90% of the failure. We believe our techniques, findings, and tools can help to stabilize the Rust compiler, ultimately enhancing the security and reliability of the Rust ecosystem.


title: Explainable Gated Bayesian Recurrent Neural Network for Non-Markov State Estimation

abstract: The optimality of Bayesian filtering relies on the completeness of prior models, while deep learning holds a distinct advantage in learning models from offline data. Nevertheless, the current fusion of these two methodologies remains largely ad hoc, lacking a theoretical foundation. This paper presents a novel solution, namely an explainable gated Bayesian recurrent neural network specifically designed to state estimation under model mismatches. Firstly, we transform the non-Markov state-space model into an equivalent first-order Markov model with memory. It is a generalized transformation that overcomes the limitations of the first-order Markov property and enables recursive filtering. Secondly, by deriving a data-assisted joint state-memory-mismatch Bayesian filtering, we design a Bayesian gated framework that includes a memory update gate for capturing the temporal regularities in state evolution, a state prediction gate with the evolution mismatch compensation, and a state update gate with the observation mismatch compensation. The Gaussian approximation implementation of the filtering process within the gated framework is derived, taking into account the computational efficiency. Finally, the corresponding internal neural network structures and end-to-end training methods are designed. The Bayesian filtering theory enhances the interpretability of the proposed gated network, enabling the effective integration of offline data and prior models within functionally explicit gated units. In comprehensive experiments, including simulations and real-world datasets, the proposed gated network demonstrates superior estimation performance compared to benchmark filters and state-of-the-art deep learning filtering methods.


title: Blind Image Super-resolution with Rich Texture-Aware Codebooks

abstract: Blind super-resolution (BSR) methods based on high-resolution (HR) reconstruction codebooks have achieved promising results in recent years. However, we find that a codebook based on HR reconstruction may not effectively capture the complex correlations between low-resolution (LR) and HR images. In detail, multiple HR images may produce similar LR versions due to complex blind degradations, causing the HR-dependent only codebooks having limited texture diversity when faced with confusing LR inputs. To alleviate this problem, we propose the Rich Texture-aware Codebook-based Network (RTCNet), which consists of the Degradation-robust Texture Prior Module (DTPM) and the Patch-aware Texture Prior Module (PTPM). DTPM effectively mines the cross-resolution correlation of textures between LR and HR images by exploiting the cross-resolution correspondence of textures. PTPM uses patch-wise semantic pre-training to correct the misperception of texture similarity in the high-level semantic regularization. By taking advantage of this, RTCNet effectively gets rid of the misalignment of confusing textures between HR and LR in the BSR scenarios. Experiments show that RTCNet outperforms state-of-the-art methods on various benchmarks by up to 0.16 ~ 0.46dB.


title: Exploring Iterative Refinement with Diffusion Models for Video Grounding

abstract: Video grounding aims to localize the target moment in an untrimmed video corresponding to a given sentence query. Existing methods typically select the best prediction from a set of predefined proposals or directly regress the target span in a single-shot manner, resulting in the absence of a systematical prediction refinement process. In this paper, we propose DiffusionVG, a novel framework with diffusion models that formulates video grounding as a conditional generation task, where the target span is generated from Gaussian noise inputs and interatively refined in the reverse diffusion process. During training, DiffusionVG progressively adds noise to the target span with a fixed forward diffusion process and learns to recover the target span in the reverse diffusion process. In inference, DiffusionVG can generate the target span from Gaussian noise inputs by the learned reverse diffusion process conditioned on the video-sentence representations. Without bells and whistles, our DiffusionVG demonstrates superior performance compared to existing well-crafted models on mainstream Charades-STA, ActivityNet Captions and TACoS benchmarks.


title: Lookup Table meets Local Laplacian Filter: Pyramid Reconstruction Network for Tone Mapping

abstract: Tone mapping aims to convert high dynamic range (HDR) images to low dynamic range (LDR) representations, a critical task in the camera imaging pipeline. In recent years, 3-Dimensional LookUp Table (3D LUT) based methods have gained attention due to their ability to strike a favorable balance between enhancement performance and computational efficiency. However, these methods often fail to deliver satisfactory results in local areas since the look-up table is a global operator for tone mapping, which works based on pixel values and fails to incorporate crucial local information. To this end, this paper aims to address this issue by exploring a novel strategy that integrates global and local operators by utilizing closed-form Laplacian pyramid decomposition and reconstruction. Specifically, we employ image-adaptive 3D LUTs to manipulate the tone in the low-frequency image by leveraging the specific characteristics of the frequency information. Furthermore, we utilize local Laplacian filters to refine the edge details in the high-frequency components in an adaptive manner. Local Laplacian filters are widely used to preserve edge details in photographs, but their conventional usage involves manual tuning and fixed implementation within camera imaging pipelines or photo editing tools. We propose to learn parameter value maps progressively for local Laplacian filters from annotated data using a lightweight network. Our model achieves simultaneous global tone manipulation and local edge detail preservation in an end-to-end manner. Extensive experimental results on two benchmark datasets demonstrate that the proposed method performs favorably against state-of-the-art methods.


title: How do Language Models Bind Entities in Context?

abstract: To correctly use in-context information, language models (LMs) must bind entities to their attributes. For example, given a context describing a "green square" and a "blue circle", LMs must bind the shapes to their respective colors. We analyze LM representations and identify the binding ID mechanism: a general mechanism for solving the binding problem, which we observe in every sufficiently large model from the Pythia and LLaMA families. Using causal interventions, we show that LMs' internal activations represent binding information by attaching binding ID vectors to corresponding entities and attributes. We further show that binding ID vectors form a continuous subspace, in which distances between binding ID vectors reflect their discernability. Overall, our results uncover interpretable strategies in LMs for representing symbolic knowledge in-context, providing a step towards understanding general in-context reasoning in large-scale LMs.


title: Single-Motor Robotic Gripper With Three Functional Modes for Grasping in Confined Spaces

abstract: This study proposes a novel robotic gripper driven by a single motor. The main task is to pick up objects in confined spaces. For this purpose, the developed gripper has three operating modes: grasping, finger-bending, and pull-in modes. Using these three modes, the developed gripper can rotate and translate a grasped object, i.e., can perform in-hand manipulation. This in-hand manipulation is effective for grasping in extremely confined spaces, such as the inside of a box in a shelf, to avoid interference between the grasped object and obstacles. To achieve the three modes using a single motor, the developed gripper is equipped with two novel self-motion switching mechanisms. These mechanisms switch their motions automatically when the motion being generated is prevented. An analysis of the mechanism and control methodology used to achieve the desired behavior are presented. Furthermore, the validity of the analysis and methodology are experimentally demonstrated. The gripper performance is also evaluated through the grasping tests.


title: Automatic Edge Error Judgment in Figure Skating Using 3D Pose Estimation from a Monocular Camera and IMUs

abstract: Automatic evaluating systems are fundamental issues in sports technologies. In many sports, such as figure skating, automated evaluating methods based on pose estimation have been proposed. However, previous studies have evaluated skaters' skills in 2D analysis. In this paper, we propose an automatic edge error judgment system with a monocular smartphone camera and inertial sensors, which enable us to analyze 3D motions. Edge error is one of the most significant scoring items and is challenging to automatically judge due to its 3D motion. The results show that the model using 3D joint position coordinates estimated from the monocular camera as the input feature had the highest accuracy at 83% for unknown skaters' data. We also analyzed the detailed motion analysis for edge error judgment. These results indicate that the monocular camera can be used to judge edge errors automatically. We will provide the figure skating single Lutz jump dataset, including pre-processed videos and labels, at https://github.com/ryota-takedalab/JudgeAI-LutzEdge.


title: Privacy-preserving Representation Learning for Speech Understanding

abstract: Existing privacy-preserving speech representation learning methods target a single application domain. In this paper, we present a novel framework to anonymize utterance-level speech embeddings generated by pre-trained encoders and show its effectiveness for a range of speech classification tasks. Specifically, given the representations from a pre-trained encoder, we train a Transformer to estimate the representations for the same utterances spoken by other speakers. During inference, the extracted representations can be converted into different identities to preserve privacy. We compare the results with the voice anonymization baselines from the VoicePrivacy 2022 challenge. We evaluate our framework on speaker identification for privacy and emotion recognition, depression classification, and intent classification for utility. Our method outperforms the baselines on privacy and utility in paralinguistic tasks and achieves comparable performance for intent classification.


title: Reconstructing the early-universe expansion and thermal history

abstract: We present a model-independent reconstruction of the early expansion and thermal histories of the universe, obtained from light element abundance measurements. The expansion history is tightly constrained around the onset of the Big Bang Nucleosynthesis (BBN). The temperature of photons is additionally constrained around the time of neutrino decoupling. Allowing for perturbations to the standard expansion rate, we find that the radiation energy density is constrained to within 15% of its $\Lambda$CDM value, and only 1% extra matter energy density is allowed around the epoch of BBN. We introduce a new and general analytic fitting formula for the temperature variation, which is flexible enough to reproduce the signal of large classes of beyond-CDM particle models that can alter the temperature through early-time energy injection. We present its constraints from BBN data and from the measurements of effective number of relativistic species and helium-4 abundance probed by the Cosmic Microwave Background radiation anisotropy. Our results provide clarity on the most fundamental properties of the early universe, reconstructed with minimal assumptions about the unknown physics that can occur at keV--MeV energy scales and can be mapped to broad classes of models of interest to cosmology.


title: Age Determination of LAMOST Red Giant Branch stars based on the Gradient Boosting Decision Tree method

abstract: In this study we estimate the stellar ages of LAMOST DR8 Red Giant Branch (RGB) stars based on the Gradient Boosting Decision Tree algorithm (GBDT). We used 2,643 RGB stars extracted from the APOKASC-2 astero-seismological catalog as training data-set. After selecting the parameterses ([$\alpha$/Fe], [C/Fe], T$_{eff}$, [N/Fe], [C/H], log g) highly correlated with age using GBDT, we apply the same GBDT method to the new catalog of more than 590,000 stars classified as RGB stars. The test data-set shows that the median relative error is around 11.6$\%$ for the method. We also compare the predicted ages of RGB stars with other studies (e.g., based on APOGEE), and find systematic differences. The final uncertainty is about 15 to 30$\%$ compared to open clusters' ages. Then we present the spatial distribution of the RGB sample having an age determination, which could recreate the expected result, and discuss systematic biases. All these diagnostics show that one can apply the GBDT method to other stellar samples to estimate atmospheric parameters and age.


title: Lightweight High-Speed and High-Force Gripper for Assembly

abstract: This paper presents a novel industrial robotic gripper with a high grasping speed (maximum: 1396 mm/s), high tip force (maximum: 80 N) for grasping, large motion range, and lightweight design (0.3 kg). To realize these features, the high-speed section of the quick-return mechanism and load-sensitive continuously variable transmission mechanism are installed in the gripper. The gripper is also equipped with a self-centering function. The high grasping speed and self-centering function improve the cycle time in robotic operations. In addition, the high tip force is advantageous for stably grasping and assembling heavy objects. Moreover, the design of the gripper reduce the gripper's proportion of the manipulator's payload, thus increasing the weight of the object that can be grasped. The gripper performance was validated through kinematic and static analyses as well as experimental evaluations. This paper also presents the analysis of the self-centering function of the developed gripper.


title: Controlling all Degrees of Freedom of the Optical Coupling in Hybrid Quantum Photonics

abstract: Nanophotonic quantum devices can significantly boost light-matter interaction which is important for applications such as quantum networks. Reaching a high interaction strength between an optical transition of a spin system and a single mode of light is an essential step which demands precise control over all degrees of freedom of the optical coupling. While current devices have reached a high accuracy of emitter positioning, the placement process remains overall statistically, reducing the device fabrication yield. Furthermore, not all degrees of freedom of the optical coupling can be controlled limiting the device performance. Here, we develop a hybrid approach based on negatively-charged silicon-vacancy center in nanodiamonds coupled to a mode of a Si$_3$N$_4$-photonic crystal cavity, where all terms of the coupling strength can be controlled individually. We use the frequency of coherent Rabi-oscillations and line-broadening as a measure of the device performance. This allows for iterative optimization of the position and the rotation of the dipole with respect to individual, preselected modes of light. Therefore, our work marks an important step for optimization of hybrid quantum photonics and enables to align device simulations with real device performance.


title: Constraints on the Primordial Curvature Power Spectrum by Pulsar Timing Array Data: A Polynomial Parameterization Approach

abstract: The recent stochastic signal observed jointly by NANOGrav, PPTA, EPTA, and CPTA can be accounted for by scalar-induced gravitational waves (SIGWs). The source of the SIGWs is from the primordial curvature perturbations, and the main contribution to the SIGWs is from the peak of the primordial curvature power spectrum. To effectively model this peak, we apply the Taylor expansion to parameterize it. With the Taylor expansion parameterization, we apply Bayesian methods to constrain the primordial curvature power spectrum based on the NANOGrav 15-year data set. The constraint on the primordial curvature power spectrum possesses a degree of generality, as the Taylor expansion can effectively approximate a wide range of function profiles.


title: Taming Gradient Variance in Federated Learning with Networked Control Variates

abstract: Federated learning, a decentralized approach to machine learning, faces significant challenges such as extensive communication overheads, slow convergence, and unstable improvements. These challenges primarily stem from the gradient variance due to heterogeneous client data distributions. To address this, we introduce a novel Networked Control Variates (FedNCV) framework for Federated Learning. We adopt the REINFORCE Leave-One-Out (RLOO) as a fundamental control variate unit in the FedNCV framework, implemented at both client and server levels. At the client level, the RLOO control variate is employed to optimize local gradient updates, mitigating the variance introduced by data samples. Once relayed to the server, the RLOO-based estimator further provides an unbiased and low-variance aggregated gradient, leading to robust global updates. This dual-side application is formalized as a linear combination of composite control variates. We provide a mathematical expression capturing this integration of double control variates within FedNCV and present three theoretical results with corresponding proofs. This unique dual structure equips FedNCV to address data heterogeneity and scalability issues, thus potentially paving the way for large-scale applications. Moreover, we tested FedNCV on six diverse datasets under a Dirichlet distribution with {\alpha} = 0.1, and benchmarked its performance against six SOTA methods, demonstrating its superiority.


title: Beampattern Design in Non-Uniform MIMO Communication

abstract: In recent years and with introduction of 5G cellular network and communication, researchers have shown great interest in Multiple Input Multiple Output (MIMO) communication, an advanced technology. Many studies have examined the problem of designing the beampattern for MIMO communication using uniform arrays and the covariance-based method to concentrate the transmitted power to the users. However, this paper aims to tackle this issue in the context of non-uniform arrays. Previous authors have primarily focused on designing the transmitted beampattern based on the cross-correlation matrix of transmitted signal elements. In contrast, this paper suggests optimizing the positions of transmitted antennas along with the cross-correlation matrix. This approach is expected to produce better results.


title: miditok: A Python package for MIDI file tokenization

abstract: Recent progress in natural language processing has been adapted to the symbolic music modality. Language models, such as Transformers, have been used with symbolic music for a variety of tasks among which music generation, modeling or transcription, with state-of-the-art performances. These models are beginning to be used in production products. To encode and decode music for the backbone model, they need to rely on tokenizers, whose role is to serialize music into sequences of distinct elements called tokens. MidiTok is an open-source library allowing to tokenize symbolic music with great flexibility and extended features. It features the most popular music tokenizations, under a unified API. It is made to be easily used and extensible for everyone.


title: Probing spin and pseudospin symmetries in deformed nuclei by the Green's function method

abstract: (Pseudo)spin symmetries play vital roles in nuclear physics and have been studied extensively in spherical nuclei. In this work, possible spin and pseudospin symmetries in deformed nuclei are examined by solving a coupled-channel Dirac equation with quadruple deformation. The Green's function method is taken which provides a novel way to exactly determine the single-particle levels and properly describe the spacial density distributions. Taking axially-deformed nucleus $^{154}$Dy as an example, the spin doublets with a combination of Nilsson levels $\Lambda\pm 1/2[\mathcal{N},n_z, \Lambda]$ and pseudospin doublets with a combination of $\widetilde{\Lambda}\pm 1/2[\widetilde{\mathcal{N},n_z, \Lambda}]$ are determined. Different behaviors are displayed for the spin and pseudospin doublets. For the spin partners, those with smaller angular momentum $l$ and the third component $\Lambda$ owns better symmetry such as the $1p$ doublet while good pseudospin symmetry appears in partners locating close to the continuum threshold. By examining the single-particle Nilsson levels $\Omega[\mathcal{N},n_z,\Lambda]$ and the energy splittings between the partners, the conservation and breaking of SS and PSS are examined at different deformations. In the prolate side, the Nilsson levels for the spin and pseudospin doublets are almost parallel and the energy splittings are stable against varying deformations. By examining the density distributions, great similarities have been observed in the upper components for the spin doublets while great similarities in the lower component for the pseudospin doublets. Besides, these similarities maintain well at different deformations.


title: Cold molecules in HI 21cm absorbers across redshifts 0.1-4

abstract: Absorption lines at high redshift in front of quasars are rare in the mm domain. Only five associated and five intervening systems have been reported in the literature. These bring very useful information complementary to emission lines, for instance, to distinguish between inflows and outflows. They are also good candidates to study the variations of the fundamental constants. We report here the search for molecules in emission and absorption in front of a sample of 30 targets, comprising 16 associated and 14 intervening HI 21-cm absorbers. The observations have been done with the IRAM-30m telescope, simultaneously at 3mm and 2mm, exploring CO ladder and HCO+ lines. Eight targets have been detected in emission, of which five are new. Their molecular gas masses range from 10^9 to 7 10^11 Mo. We also report four new detections in absorption. Two of the associated CO absorption line detections at high redshift (z=1.211 and 1.275) resulted from the high spatial resolution follow-up with NOEMA. The disparity between the mm molecular and HI 21-cm absorption lines for these and another intervening system detected in HNC at z = 1.275, is attributable to radio and mm sight lines tracing different media. Comparing HI and H2 in the 14 known high redshift molecular absorbers, associated HI absorption lines are broad, with multiple components and the molecular absorption corresponds to the broader and weaker 21-cm absorption component. This indicates two distinct phases: one near galaxy centers with a larger CO-to-HI abundance ratio, and another with lower molecular abundance in the outer regions of the galaxy. The comparison of interferometric and single dish observations shows that the detection of absorption requires sufficient spatial resolution to overcome the dilution by emission, and will be an important criterion for mm follow-up of 21-cm absorbers from ongoing large-scale surveys.


title: Local Coordination Modulates the Reflectivity of Liquefied Si-Ge Alloys

abstract: The properties of liquid Si-Ge binary systems at melting conditions deviate from those expected by the ideal alloy approximation. Particularly, a non-linear dependence of the dielectric functions occurs with the reflectivity of liquid Si-Ge reaching a maximum at 50\% Ge content, being 10\% higher than in pure Si or Ge. Using \textit{ab initio} methodologies, we modelled liquefied Si-Ge alloys, unveiling very high coordination numbers and poor symmetry in the first coordination shell with respect to Si and Ge, related to different bonding properties. We simulated optical functions, quantitatively replicating the aforementioned reflectivity trend and we highlighted a direct relationship between atomic structure and optical properties, indicating that the unusual optics arises from Si-Ge higher local coordination characterized by low symmetry. We forecast further implications for the overall class of these alloys. These findings expand our comprehension of liquefied semiconductors and are essential for implementing controlled laser melting procedures to highly dope these materials for advanced transistors, superconductors, sensors and plasmonic devices.


title: Helicity resolved Raman spectroscopy of mono- and a few-layers thick PtSe$_2$

abstract: We studied helicity resolved Raman scattering in PtSe$_2$ flakes with different thicknesses. The peak amplitude of helicity-switched Raman scattering is significantly larger than that of helicity-conserved scattering for the in-plane $E_{g}$ mode, consistent with the Raman tensor analyses and conservation law of angular momentum. The peak amplitude of the helicity-switched $E_{g}$ mode is larger for the thinner flakes. In addition, we find Raman peaks near the energy levels of infrared (IR)-active $E_u$ and $A_{2u}$ modes, only for monolayer and a few-layers thick flakes. Interestingly, these peaks manifest themselves only for helicity-switched Raman scattering; they are nearly absent for helicity-conserved scattering.


title: Efficient Data Fusion using the Tsetlin Machine

abstract: We propose a novel way of assessing and fusing noisy dynamic data using a Tsetlin Machine. Our approach consists in monitoring how explanations in form of logical clauses that a TM learns changes with possible noise in dynamic data. This way TM can recognize the noise by lowering weights of previously learned clauses, or reflect it in the form of new clauses. We also perform a comprehensive experimental study using notably different datasets that demonstrated high performance of the proposed approach.


title: Entanglement in Cosmology

abstract: We compute the evolution of the entanglement entropy for a massless field within a spherical region throughout the inflationary period and the subsequent era of radiation domination, starting from the Bunch-Davies vacuum. In order to focus on the entanglement of modes that are directly accessible to observations, we impose an ultraviolet cutoff set by the wavelength of the last mode that exited the horizon at the end of inflation. The transition of each mode towards a squeezed state upon horizon exit during inflation and the additional squeezing when radiation domination sets in enhance the entanglement entropy. Shortly after the transition to the radiation-dominated era, a volume term develops and becomes the leading contribution to the entropy at late times, as is common for systems lying in squeezed states. We estimate the magnitude of the entropy and discuss its interpretation in the light of the quantum to classical transition for modes exiting the horizon during inflation. Our results raise the possibility that the quantum nature of weakly interacting fields, such as gravitational waves resulting from tensor modes during inflation, may be detectable in today's universe. On the other hand, an observer with no knowledge of the degrees of freedom beyond the horizon would interpret the entropy as thermal. From this point of view, the reheating after inflation would be a result of quantum entanglement.


title: Weakly-Supervised Surgical Phase Recognition

abstract: A key element of computer-assisted surgery systems is phase recognition of surgical videos. Existing phase recognition algorithms require frame-wise annotation of a large number of videos, which is time and money consuming. In this work we join concepts of graph segmentation with self-supervised learning to derive a random-walk solution for per-frame phase prediction. Furthermore, we utilize within our method two forms of weak supervision: sparse timestamps or few-shot learning. The proposed algorithm enjoys low complexity and can operate in lowdata regimes. We validate our method by running experiments with the public Cholec80 dataset of laparoscopic cholecystectomy videos, demonstrating promising performance in multiple setups.


title: Summation formulas generated by Hilbert space eigenproblem

abstract: We demonstrate that certain classes of Schl\" omilch-like infinite series and series that include generalized hypergeometric functions can be calculated in closed form starting from a simple quantum model of a particle trapped inside an infinite potential well and using principles of quantum mechanics. We provide a general framework based on the Hilbert space eigenproblem that can be applied to different exactly solvable quantum models. Obtaining series from normalization conditions in well-defined quantum problems secures their convergence.


title: On the origin of V-shaped polarisation spectra in molecular clouds

abstract: In this work we extend previous theoretical works to gain a better understanding of the origin of recently observed polarisation degree spectra of molecular clouds, which show a so-called V-shape, i.e. a pronounced minimum around 350 $\mu$m. For this purpose, we present results of semi-analytical dust polarisation models. We benchmark our model against dust polarisation radiative transfer calculations performed with POLARIS. We show that V-shaped polarisation spectra can only be obtained if two dust phases, one dense and cold and one warm and dilute phase, are present along the line of sight. In contrast to previous results, no correlation between the alignment efficiency of silicate grains and the dust temperature is required; carbon grains are assumed to be not aligned with the magnetic field. We find that the V-shape is the stronger pronounced the larger the density and temperature contrast between both phases is. Moreover, the destruction of carbon grains by UV radiation in the warm and dilute phase leads to a significantly more pronounced V-shape in the polarisation spectrum. Reducing the alignment efficiency in the cold and dense phase also results in a more pronounced V-shape, its effect, however, is smaller than that of the UV-induced carbon grain destruction. Furthermore, we present a first, self-consistent polarisation spectrum obtained from a 3D, magneto-hydrodynamical molecular cloud simulation. The spectrum matches well with our semi-analytical prediction demonstrating the potential of such complex 3D simulations to study polarisation spectra. Comparing our model results with actual observations indicates that carbon grain destruction in illuminated regions might be required to match these observations. Reducing the alignment efficiency of silicate grains in the cold and dense phase would further improve the match between both data, however, it appears to not be a necessity.