title: Interactive $360^{\circ}$ Video Streaming Using FoV-Adaptive Coding with Temporal Prediction

abstract: For $360^{\circ}$ video streaming, FoV-adaptive coding that allocates more bits for the predicted user's field of view (FoV) is an effective way to maximize the rendered video quality under the limited bandwidth. We develop a low-latency FoV-adaptive coding and streaming system for interactive applications that is robust to bandwidth variations and FoV prediction errors. To minimize the end-to-end delay and yet maximize the coding efficiency, we propose a frame-level FoV-adaptive inter-coding structure. In each frame, regions that are in or near the predicted FoV are coded using temporal and spatial prediction, while a small rotating region is coded with spatial prediction only. This rotating intra region periodically refreshes the entire frame, thereby providing robustness to both FoV prediction errors and frame losses due to transmission errors. The system adapts the sizes and rates of different regions for each video segment to maximize the rendered video quality under the predicted bandwidth constraint. Integrating such frame-level FoV adaptation with temporal prediction is challenging due to the temporal variations of the FoV. We propose novel ways for modeling the influence of FoV dynamics on the quality-rate performance of temporal predictive coding.We further develop LSTM-based machine learning models to predict the user's FoV and network bandwidth.The proposed system is compared with three benchmark systems, using real-world network bandwidth traces and FoV traces, and is shown to significantly improve the rendered video quality, while achieving very low end-to-end delay and low frame-freeze probability.


title: Journey into SPH Simulation: A Comprehensive Framework and Showcase

abstract: This report presents the development and results of an advanced SPH (Smoothed Particle Hydrodynamics) simulation framework, designed for high fidelity fluid dynamics modeling. Our framework, accessible at https://github.com/jason-huang03/SPH_Project, integrates various SPH algorithms including WCSPH, PCISPH, and DFSPH, alongside techniques for rigid-fluid coupling and high viscosity fluid simulations. Leveraging the computational power of CUDA and the versatility of Taichi, the framework excels in handling large-scale simulations with millions of particles. We demonstrate the capability of our framework through a series of simulations showcasing rigid-fluid coupling, high viscosity fluids, and large-scale fluid dynamics. Furthermore, a detailed performance analysis reveals CUDA's superior efficiency across different hardware platforms. This work is an exploraion into modern SPH simulation techniques, showcasing their practical implementation and capabilities.


title: Selective Hourglass Mapping for Universal Image Restoration Based on Diffusion Model

abstract: Universal image restoration is a practical and potential computer vision task for real-world applications. The main challenge of this task is handling the different degradation distributions at once. Existing methods mainly utilize task-specific conditions (e.g., prompt) to guide the model to learn different distributions separately, named multi-partite mapping. However, it is not suitable for universal model learning as it ignores the shared information between different tasks. In this work, we propose an advanced selective hourglass mapping strategy based on diffusion model, termed DiffUIR. Two novel considerations make our DiffUIR non-trivial. Firstly, we equip the model with strong condition guidance to obtain accurate generation direction of diffusion model (selective). More importantly, DiffUIR integrates a flexible shared distribution term (SDT) into the diffusion algorithm elegantly and naturally, which gradually maps different distributions into a shared one. In the reverse process, combined with SDT and strong condition guidance, DiffUIR iteratively guides the shared distribution to the task-specific distribution with high image quality (hourglass). Without bells and whistles, by only modifying the mapping strategy, we achieve state-of-the-art performance on five image restoration tasks, 22 benchmarks in the universal setting and zero-shot generalization setting. Surprisingly, by only using a lightweight model (only 0.89M), we could achieve outstanding performance. The source code and pre-trained models are available at https://github.com/iSEE-Laboratory/DiffUIR


title: An Empirical Study on JIT Defect Prediction Based on BERT-style Model

abstract: Previous works on Just-In-Time (JIT) defect prediction tasks have primarily applied pre-trained models directly, neglecting the configurations of their fine-tuning process. In this study, we perform a systematic empirical study to understand the impact of the settings of the fine-tuning process on BERT-style pre-trained model for JIT defect prediction. Specifically, we explore the impact of different parameter freezing settings, parameter initialization settings, and optimizer strategies on the performance of BERT-style models for JIT defect prediction. Our findings reveal the crucial role of the first encoder layer in the BERT-style model and the project sensitivity to parameter initialization settings. Another notable finding is that the addition of a weight decay strategy in the Adam optimizer can slightly improve model performance. Additionally, we compare performance using different feature extractors (FCN, CNN, LSTM, transformer) and find that a simple network can achieve great performance. These results offer new insights for fine-tuning pre-trained models for JIT defect prediction. We combine these findings to find a cost-effective fine-tuning method based on LoRA, which achieve a comparable performance with only one-third memory consumption than original fine-tuning process.


title: Deep Neural Crossover

abstract: We present a novel multi-parent crossover operator in genetic algorithms (GAs) called ``Deep Neural Crossover'' (DNC). Unlike conventional GA crossover operators that rely on a random selection of parental genes, DNC leverages the capabilities of deep reinforcement learning (DRL) and an encoder-decoder architecture to select the genes. Specifically, we use DRL to learn a policy for selecting promising genes. The policy is stochastic, to maintain the stochastic nature of GAs, representing a distribution for selecting genes with a higher probability of improving fitness. Our architecture features a recurrent neural network (RNN) to encode the parental genomes into latent memory states, and a decoder RNN that utilizes an attention-based pointing mechanism to generate a distribution over the next selected gene in the offspring. To improve the training time, we present a pre-training approach, wherein the architecture is initially trained on a single problem within a specific domain and then applied to solving other problems of the same domain. We compare DNC to known operators from the literature over two benchmark domains -- bin packing and graph coloring. We compare with both two- and three-parent crossover, outperforming all baselines. DNC is domain-independent and can be easily applied to other problem domains.


title: All-thermal reversal of heat currents using qutrits

abstract: Few-level systems coupled to thermal baths provide useful models for quantum thermodynamics and the role of heat currents in quantum information settings. Useful operations such as cooling or thermal masers have been proposed in autonomous three-level systems. In this work, we propose the coherent coupling of two qutrits as a simultaneous refrigerator and heat pump of two reservoirs forming a system. This occurs thanks to the coupling to two other reservoirs which are out of equilibrium but do not inject heat in the system. We explore the thermodynamic performance of such operation and discuss whether it can be distinguished from the action of a Maxwell demon via measurements of current fluctuations limited to the working substance.


title: Floquet-Bloch functions on non-simply connected manifolds, the Aharonov-Bohm fluxes, and conformal invariants of immersed surfaces

abstract: Spectral (Bloch) varieties of multidimensional differential operators on non-simply connected manifolds are defined. In their terms it is given a description of the analytical dependence of the spectra of magnetic Laplacians on non-simply connected manifolds on the values of the Aharonov-Bohm fluxes and a construction of analogues of spectral curves for two-dimensional Dirac operators on Riemann surfaces and, thereby, new conformal invariants of immersions of surfaces into 3- and 4-dimensional Euclidean spaces.


title: CGI-DM: Digital Copyright Authentication for Diffusion Models via Contrasting Gradient Inversion

abstract: Diffusion Models (DMs) have evolved into advanced image generation tools, especially for few-shot generation where a pretrained model is fine-tuned on a small set of images to capture a specific style or object. Despite their success, concerns exist about potential copyright violations stemming from the use of unauthorized data in this process. In response, we present Contrasting Gradient Inversion for Diffusion Models (CGI-DM), a novel method featuring vivid visual representations for digital copyright authentication. Our approach involves removing partial information of an image and recovering missing details by exploiting conceptual differences between the pretrained and fine-tuned models. We formulate the differences as KL divergence between latent variables of the two models when given the same input image, which can be maximized through Monte Carlo sampling and Projected Gradient Descent (PGD). The similarity between original and recovered images serves as a strong indicator of potential infringements. Extensive experiments on the WikiArt and Dreambooth datasets demonstrate the high accuracy of CGI-DM in digital copyright authentication, surpassing alternative validation techniques. Code implementation is available at https://github.com/Nicholas0228/Revelio.


title: A Selective Review on Statistical Methods for Massive Data Computation: Distributed Computing, Subsampling, and Minibatch Techniques

abstract: This paper presents a selective review of statistical computation methods for massive data analysis. A huge amount of statistical methods for massive data computation have been rapidly developed in the past decades. In this work, we focus on three categories of statistical computation methods: (1) distributed computing, (2) subsampling methods, and (3) minibatch gradient techniques. The first class of literature is about distributed computing and focuses on the situation, where the dataset size is too huge to be comfortably handled by one single computer. In this case, a distributed computation system with multiple computers has to be utilized. The second class of literature is about subsampling methods and concerns about the situation, where the sample size of dataset is small enough to be placed on one single computer but too large to be easily processed by its memory as a whole. The last class of literature studies those minibatch gradient related optimization techniques, which have been extensively used for optimizing various deep learning models.


title: The Effects of Generative AI on Design Fixation and Divergent Thinking

abstract: Generative AI systems have been heralded as tools for augmenting human creativity and inspiring divergent thinking, though with little empirical evidence for these claims. This paper explores the effects of exposure to AI-generated images on measures of design fixation and divergent thinking in a visual ideation task. Through a between-participants experiment (N=60), we found that support from an AI image generator during ideation leads to higher fixation on an initial example. Participants who used AI produced fewer ideas, with less variety and lower originality compared to a baseline. Our qualitative analysis suggests that the effectiveness of co-ideation with AI rests on participants' chosen approach to prompt creation and on the strategies used by participants to generate ideas in response to the AI's suggestions. We discuss opportunities for designing generative AI systems for ideation support and incorporating these AI tools into ideation workflows.


title: 4-Dimensional Isoparametric Hypersurfaces of Index 2 in the Pseudo-Riemannian Space Forms

abstract: We study isoparametric hypersurfaces, whose principal curvatures are all constant, in the pseudo-Riemannian space forms. In this paper, we investigate three topics.Firstly, according to Petrov's classification theorem, we give a classification of hypersurfaces of index 2 with respect to a pair of a shape operator and a metric. Therefore, we can define types of isoparametric hypersurfaces of index 2 concerning the classification. Secondly, we give several examples of certain types. Thirdly, we show that there exist no isoparametric hypersurfaces of index 2 whose shape operators have complex principal curvatures in certain cases.


title: Pencil: Private and Extensible Collaborative Learning without the Non-Colluding Assumption

abstract: The escalating focus on data privacy poses significant challenges for collaborative neural network training, where data ownership and model training/deployment responsibilities reside with distinct entities. Our community has made substantial contributions to addressing this challenge, proposing various approaches such as federated learning (FL) and privacy-preserving machine learning based on cryptographic constructs like homomorphic encryption (HE) and secure multiparty computation (MPC). However, FL completely overlooks model privacy, and HE has limited extensibility (confined to only one data provider). While the state-of-the-art MPC frameworks provide reasonable throughput and simultaneously ensure model/data privacy, they rely on a critical non-colluding assumption on the computing servers, and relaxing this assumption is still an open problem. In this paper, we present Pencil, the first private training framework for collaborative learning that simultaneously offers data privacy, model privacy, and extensibility to multiple data providers, without relying on the non-colluding assumption. Our fundamental design principle is to construct the n-party collaborative training protocol based on an efficient two-party protocol, and meanwhile ensuring that switching to different data providers during model training introduces no extra cost. We introduce several novel cryptographic protocols to realize this design principle and conduct a rigorous security and privacy analysis. Our comprehensive evaluations of Pencil demonstrate that (i) models trained in plaintext and models trained privately using Pencil exhibit nearly identical test accuracies; (ii) The training overhead of Pencil is greatly reduced: Pencil achieves 10 ~ 260x higher throughput and 2 orders of magnitude less communication than prior art; (iii) Pencil is resilient against both existing and adaptive (white-box) attacks.


title: Theoretical and numerical comparison between the pseudopotential and the free energy lattice Boltzmann methods

abstract: The pseudopotential and free energy models are two popular extensions of the lattice Boltzmann method for multiphase flows. Until now, they have been developed apart from each other in the literature. However, important questions about whether each method performs better needs to be solved. In this work, we perform a theoretical and numerical comparison between both methods. This comparison is only possible because we developed a novel approach for controlling the interface thickness in the pseudopotential method independently on the equation of state. In this way, it is possible to compare both methods maintaining the same equilibrium densities, interface thickness, surface tension and equation of state parameters. The well-balanced approach was selected to represent the free energy. We found that the free energy one is more practical to use, as it is not necessary to carry out previous simulations to determine simulation parameters (interface thickness, surface tension, etc). In addition, the tests proofed that the free energy model is more accurate than the pseudopotential model. Furthermore, the pseudopotential method suffers from a lack of thermodynamic consistency even when applying the corrections proposed in the literature. On the other hand, for both static and dynamic tests we verified that the pseudopotential method is more stable than the free energy one, allowing simulations with lower reduced temperatures. We hope that these results will guide authors in the use of each method.


title: Semibrick-cosilting correspondence

abstract: Let $\Lambda$ be a finite dimensional algebra. In this paper we show that there is a natural bijection between cosilting modules in Mod$\Lambda$ and semibricks in Mod$\Lambda$ satisfying some condition. Also this bijection restricts to a bijection between all semibricks in mod$\Lambda$ and a certain subclass of cosilting modules. These bijections are generalizations of Asai's correspondence [7] between support $\tau^-$-tilting modules and right finite semibricks.


title: Correcting misinformation on social media with a large language model

abstract: Real-world misinformation can be partially correct and even factual but misleading. It undermines public trust in science and democracy, particularly on social media, where it can spread rapidly. High-quality and timely correction of misinformation that identifies and explains its (in)accuracies has been shown to effectively reduce false beliefs. Despite the wide acceptance of manual correction, it is difficult to be timely and scalable, a concern as technologies like large language models (LLMs) make misinformation easier to produce. LLMs also have versatile capabilities that could accelerate misinformation correction-however, they struggle due to a lack of recent information, a tendency to produce false content, and limitations in addressing multimodal information. We propose MUSE, an LLM augmented with access to and credibility evaluation of up-to-date information. By retrieving evidence as refutations or contexts, MUSE identifies and explains (in)accuracies in a piece of content-not presupposed to be misinformation-with references. It also describes images and conducts multimodal searches to verify and correct multimodal content. Fact-checking experts evaluate responses to social media content that are not presupposed to be (non-)misinformation but broadly include incorrect, partially correct, and correct posts, that may or may not be misleading. We propose and evaluate 13 dimensions of misinformation correction quality, ranging from the accuracy of identifications and factuality of explanations to the relevance and credibility of references. The results demonstrate MUSE's ability to promptly write high-quality responses to potential misinformation on social media-overall, MUSE outperforms GPT-4 by 37% and even high-quality responses from laypeople by 29%. This work reveals LLMs' potential to help combat real-world misinformation effectively and efficiently.


title: Common substring with shifts in b-ary expansions

abstract: Denote by $S_n(x,y)$ the length of the longest common substring of $x$ and $y$ with shifts in their first $n$ digits of $b$-ary expansions. We show that the sets of pairs $(x,y)$, for which the growth rate of $S_n(x,y)$ is $\alpha \log n$ with $0\le \alpha \le \infty$, have full Hausdorff dimension.


title: A Tip for IOTA Privacy: IOTA Light Node Deanonymization via Tip Selection

abstract: IOTA is a distributed ledger technology that uses a Directed Acyclic Graph (DAG) structure called the Tangle. It is known for its efficiency and is widely used in the Internet of Things (IoT) environment. Tangle can be configured by utilizing the tip selection process. Due to performance issues with light nodes, full nodes are being asked to perform the tip selections of light nodes. However, in this paper, we demonstrate that tip selection can be exploited to compromise users' privacy. An adversary full node can associate a transaction with the identity of a light node by comparing the light node's request with its ledger. We show that these types of attacks are not only viable in the current IOTA environment but also in IOTA 2.0 and the privacy improvement being studied. We also provide solutions to mitigate these attacks and propose ways to enhance anonymity in the IOTA network while maintaining efficiency and scalability.


title: Artifact Feature Purification for Cross-domain Detection of AI-generated Images

abstract: In the era of AIGC, the fast development of visual content generation technologies, such as diffusion models, bring potential security risks to our society. Existing generated image detection methods suffer from performance drop when faced with out-of-domain generators and image scenes. To relieve this problem, we propose Artifact Purification Network (APN) to facilitate the artifact extraction from generated images through the explicit and implicit purification processes. For the explicit one, a suspicious frequency-band proposal method and a spatial feature decomposition method are proposed to extract artifact-related features. For the implicit one, a training strategy based on mutual information estimation is proposed to further purify the artifact-related features. Experiments show that for cross-generator detection, the average accuracy of APN is 5.6% ~ 16.4% higher than the previous 10 methods on GenImage dataset and 1.7% ~ 50.1% on DiffusionForensics dataset. For cross-scene detection, APN maintains its high performance. Via visualization analysis, we find that the proposed method extracts flexible forgery patterns and condenses the forgery information diluted in irrelevant features. We also find that the artifact features APN focuses on across generators and scenes are global and diverse. The code will be available on GitHub.


title: Multi-Objective Evolutionary Neural Architecture Search for Recurrent Neural Networks

abstract: Artificial neural network (NN) architecture design is a nontrivial and time-consuming task that often requires a high level of human expertise. Neural architecture search (NAS) serves to automate the design of NN architectures and has proven to be successful in automatically finding NN architectures that outperform those manually designed by human experts. NN architecture performance can be quantified based on multiple objectives, which include model accuracy and some NN architecture complexity objectives, among others. The majority of modern NAS methods that consider multiple objectives for NN architecture performance evaluation are concerned with automated feed forward NN architecture design, which leaves multi-objective automated recurrent neural network (RNN) architecture design unexplored. RNNs are important for modeling sequential datasets, and prominent within the natural language processing domain. It is often the case in real world implementations of machine learning and NNs that a reasonable trade-off is accepted for marginally reduced model accuracy in favour of lower computational resources demanded by the model. This paper proposes a multi-objective evolutionary algorithm-based RNN architecture search method. The proposed method relies on approximate network morphisms for RNN architecture complexity optimisation during evolution. The results show that the proposed method is capable of finding novel RNN architectures with comparable performance to state-of-the-art manually designed RNN architectures, but with reduced computational demand.


title: Systematic shell-model study of structure and isomeric states in $^{204-213}$Bi isotopes

abstract: In this work, we have performed systematic shell-model calculations for Bi isotopes with $A=$ 204-213 using KHH7B and KHM3Y effective interactions. We have reported yrast and non-yrast shell-model states corresponding to the available experimental data. From the comparison with the experimental data, we could assign spin and parity of several unconfirmed states. We have also calculated electromagnetic properties and compared them with the available experimental data and predicted where experimental data are not available. This study also includes a detailed discussion of multiple isomeric states based on computed shell-model configurations and their respective half-lives.


title: Prior-dependent analysis of posterior sampling reinforcement learning with function approximation

abstract: This work advances randomized exploration in reinforcement learning (RL) with function approximation modeled by linear mixture MDPs. We establish the first prior-dependent Bayesian regret bound for RL with function approximation; and refine the Bayesian regret analysis for posterior sampling reinforcement learning (PSRL), presenting an upper bound of ${\mathcal{O}}(d\sqrt{H^3 T \log T})$, where $d$ represents the dimensionality of the transition kernel, $H$ the planning horizon, and $T$ the total number of interactions. This signifies a methodological enhancement by optimizing the $\mathcal{O}(\sqrt{\log T})$ factor over the previous benchmark (Osband and Van Roy, 2014) specified to linear mixture MDPs. Our approach, leveraging a value-targeted model learning perspective, introduces a decoupling argument and a variance reduction technique, moving beyond traditional analyses reliant on confidence sets and concentration inequalities to formalize Bayesian regret bounds more effectively.

categories: stat.ML cs.AI cs.IT cs.LG math.IT math.ST stat.TH


title: Quality-Aware Image-Text Alignment for Real-World Image Quality Assessment

abstract: No-Reference Image Quality Assessment (NR-IQA) focuses on designing methods to measure image quality in alignment with human perception when a high-quality reference image is unavailable. The reliance on annotated Mean Opinion Scores (MOS) in the majority of state-of-the-art NR-IQA approaches limits their scalability and broader applicability to real-world scenarios. To overcome this limitation, we propose QualiCLIP (Quality-aware CLIP), a CLIP-based self-supervised opinion-unaware method that does not require labeled MOS. In particular, we introduce a quality-aware image-text alignment strategy to make CLIP generate representations that correlate with the inherent quality of the images. Starting from pristine images, we synthetically degrade them with increasing levels of intensity. Then, we train CLIP to rank these degraded images based on their similarity to quality-related antonym text prompts, while guaranteeing consistent representations for images with comparable quality. Our method achieves state-of-the-art performance on several datasets with authentic distortions. Moreover, despite not requiring MOS, QualiCLIP outperforms supervised methods when their training dataset differs from the testing one, thus proving to be more suitable for real-world scenarios. Furthermore, our approach demonstrates greater robustness and improved explainability than competing methods. The code and the model are publicly available at https://github.com/miccunifi/QualiCLIP.


title: $T_7$ Flavor Symmetry gym: The Key to Unlocking the Neutrino Mass Puzzle

abstract: Recent research has indicated that the Standard Model (SM), while historically highly effective, is found to be insufficient due to its prediction of zero mass for neutrinos. With the exception of a few, the majority of the parameters related to neutrinos have been determined by neutrino oscillation experiments with excellent precision. Experiments on neutrino oscillation and neutrino mixing have shown that neutrinos are massive. To fill in gaps, discrete symmetries are becoming more common alongside continuous symmetries while describing the observed pattern of neutrino mixing. Here, we present a $T_7$ flavor symmetry to explain the masses of charged leptons and neutrinos. The light neutrino mass matrix is derived using seesaw mechanism of type I, which involves the Dirac neutrino mass matrix as well as the right-handed neutrino mass matrix. We estimate the Pontecorvo-Maki-Nakagawa-Sakata matrix ($U_{PMNS}$), three mixing angles, $\theta_{12}$, $\theta_{23}$ and $\theta_{13}$, which are strongly correlated with the recent experimental results. The extent of $CP$ violation in neutrino oscillations is obtained by calculating Jarskog invariant $(J_{CP})$ on the behalf of $U_{PMNS}$. We also find the masses of three neutrinos and Effective Majorana neutrino mass parameter $\langle m_{ee} \rangle$ which is $1.0960$ $meV$ and $10.9217$ $meV$ for normal and inverted hierarchy, respectively.


title: The truncated EM scheme for multiple-delay SDEs with irregular coefficients and application to stochastic volatility model

abstract: This paper focuses on the numerical scheme for multiple-delay stochastic differential equations with partially H\"older continuous drifts and locally H\"older continuous diffusion coefficients. To handle with the superlinear terms in coefficients, the truncated Euler-Maruyama scheme is employed. Under the given conditions, the convergence rates at time $T$ in both $\mathcal{L}^{1}$ and $\mathcal{L}^{2}$ senses are shown by virtue of the Yamada-Watanabe approximation technique. Moreover, the convergence rates over a finite time interval $[0,T]$ are also obtained. Additionally, it should be noted that the convergence rates will not be affected by the number of delay variables. Finally, we perform the numerical experiments on the stochastic volatility model to verify the reliability of the theoretical results.


title: Modified Steinberg-Guinan elasticity model to describe softening-hardening dual anomaly in vanadium

abstract: Constitutive models are essential for describing the mechanical behavior of materials under high temperatures and pressures, among which the Steinberg-Guinan (SG) model is widely adopted. Recent work has discovered a peculiar dual anomaly of compression-induced softening and heating-induced hardening in the elasticity of compressed vanadium [Phys. Rev. B 104, 134102 (2021)], which is beyond the capability of the SG model to describe. In this work, a modified SG constitutive model is proposed to embody such an anomalous behavior. Elemental vanadium is considered as an example to demonstrate the effectiveness of this improved model in describing the dual anomalies of mechanical elasticity. This new variant of the SG model can also be applied to other materials that present an irregular variation in the mechanical elasticity, and is important to faithfully model and simulate the mechanical response of materials under extreme conditions.

categories: physics.app-ph cond-mat.mtrl-sci cond-mat.other physics.comp-ph


title: usfAD Based Effective Unknown Attack Detection Focused IDS Framework

abstract: The rapid expansion of varied network systems, including the Internet of Things (IoT) and Industrial Internet of Things (IIoT), has led to an increasing range of cyber threats. Ensuring robust protection against these threats necessitates the implementation of an effective Intrusion Detection System (IDS). For more than a decade, researchers have delved into supervised machine learning techniques to develop IDS to classify normal and attack traffic. However, building effective IDS models using supervised learning requires a substantial number of benign and attack samples. To collect a sufficient number of attack samples from real-life scenarios is not possible since cyber attacks occur occasionally. Further, IDS trained and tested on known datasets fails in detecting zero-day or unknown attacks due to the swift evolution of attack patterns. To address this challenge, we put forth two strategies for semi-supervised learning based IDS where training samples of attacks are not required: 1) training a supervised machine learning model using randomly and uniformly dispersed synthetic attack samples; 2) building a One Class Classification (OCC) model that is trained exclusively on benign network traffic. We have implemented both approaches and compared their performances using 10 recent benchmark IDS datasets. Our findings demonstrate that the OCC model based on the state-of-art anomaly detection technique called usfAD significantly outperforms conventional supervised classification and other OCC based techniques when trained and tested considering real-life scenarios, particularly to detect previously unseen attacks.


title: Solving Maxwell's Equations

abstract: This paper discusses the use of the Riemann-Silberstein vector to solve the source-free Maxwell's equations and obtains novel analytical solutions. The solving process naturally leads to the spinor form of the source-free Maxwell's equations. Several powerful theorems are established to solve this spinor form equation. The Waveguide Solution Theorem provides an elegant way to solve waveguide problems, while The Schrodinger Solution Theorem connects the Maxwell's equations with the two-dimensional Schrodinger equation. By utilizing The Schrodinger Solution Theorem, a precise formula for spatiotemporal diffraction of the Maxwell's equations is derived, which allows for the reconstruction of electromagnetic waves throughout space and time based on the field distribution on the diffraction screen. And finally, by studying some relevant contour integrals, two additional simple but beautiful mathematical theorems that are necessarily satisfied by electromagnetic field in any source-free region are derived.


title: Periodicity of sub-pulses in a radio pulsar

abstract: Pulsars are known to manifest complex phenomena, such as nulling, sub-pulse drifting, and periodicity. Within the purview of this investigation, we have harnessed the wavelet analysis technique to scrutinize the multifaceted periodicities and sub-pulse drifting characteristics exhibited by PSR J1926-0652, discovered by the Five-hundred-meter Aperture Spherical radio Telescope (FAST). Our analysis draws upon the rich dataset acquired from the FAST ultra-wide-bandwidth receiver (UWB), meticulously examining pulse attributes encompassing an entire pulse. It is notable that the pulse apex recurrently manifests approximately every 17.11 times the pulsar's period P, individual sub-pulses exhibit a drifting phenomenon, with a phase decrement of approximately $1.04^\circ$ over each P. Intriguingly, the central phase of each sub-pulse track gradually increments over temporal evolution. Furthermore, the relative offset distribution between successive sub-pulse tracks emanating from the trailing and leading components remains comparatively stable, with a central tendency of approximately $\sim$6.87$\pm$2.56 P. Most notably, derived from the outcomes of wavelet analysis, we ascertain a negative correlation of -0.98 between the periods of sub-pulses and their drifting rates, alongside the intrinsic period of sub-pulses identified at 28.14 seconds.


title: Decoding Continuous Character-based Language from Non-invasive Brain Recordings

abstract: Deciphering natural language from brain activity through non-invasive devices remains a formidable challenge. Previous non-invasive decoders either require multiple experiments with identical stimuli to pinpoint cortical regions and enhance signal-to-noise ratios in brain activity, or they are limited to discerning basic linguistic elements such as letters and words. We propose a novel approach to decoding continuous language from single-trial non-invasive fMRI recordings, in which a three-dimensional convolutional network augmented with information bottleneck is developed to automatically identify responsive voxels to stimuli, and a character-based decoder is designed for the semantic reconstruction of continuous language characterized by inherent character structures. The resulting decoder can produce intelligible textual sequences that faithfully capture the meaning of perceived speech both within and across subjects, while existing decoders exhibit significantly inferior performance in cross-subject contexts. The ability to decode continuous language from single trials across subjects demonstrates the promising applications of non-invasive language brain-computer interfaces in both healthcare and neuroscience.


title: DuPL: Dual Student with Trustworthy Progressive Learning for Robust Weakly Supervised Semantic Segmentation

abstract: Recently, One-stage Weakly Supervised Semantic Segmentation (WSSS) with image-level labels has gained increasing interest due to simplification over its cumbersome multi-stage counterpart. Limited by the inherent ambiguity of Class Activation Map (CAM), we observe that one-stage pipelines often encounter confirmation bias caused by incorrect CAM pseudo-labels, impairing their final segmentation performance. Although recent works discard many unreliable pseudo-labels to implicitly alleviate this issue, they fail to exploit sufficient supervision for their models. To this end, we propose a dual student framework with trustworthy progressive learning (DuPL). Specifically, we propose a dual student network with a discrepancy loss to yield diverse CAMs for each sub-net. The two sub-nets generate supervision for each other, mitigating the confirmation bias caused by learning their own incorrect pseudo-labels. In this process, we progressively introduce more trustworthy pseudo-labels to be involved in the supervision through dynamic threshold adjustment with an adaptive noise filtering strategy. Moreover, we believe that every pixel, even discarded from supervision due to its unreliability, is important for WSSS. Thus, we develop consistency regularization on these discarded regions, providing supervision of every pixel. Experiment results demonstrate the superiority of the proposed DuPL over the recent state-of-the-art alternatives on PASCAL VOC 2012 and MS COCO datasets. Code is available at https://github.com/Wu0409/DuPL.


title: Automorphisms of framed operads

abstract: Let $\mathsf P$ be an operad acted upon by a group $G$, and let $\mathsf Q=\mathsf P\rtimes G$ be the corresponding framed operad. We relate the homotopy automorphism groups of $\mathsf P$ and $\mathsf Q$. We apply the result to compute the automorphisms of the framed little disks operad.


title: NetTrack: Tracking Highly Dynamic Objects with a Net

abstract: The complex dynamicity of open-world objects presents non-negligible challenges for multi-object tracking (MOT), often manifested as severe deformations, fast motion, and occlusions. Most methods that solely depend on coarse-grained object cues, such as boxes and the overall appearance of the object, are susceptible to degradation due to distorted internal relationships of dynamic objects. To address this problem, this work proposes NetTrack, an efficient, generic, and affordable tracking framework to introduce fine-grained learning that is robust to dynamicity. Specifically, NetTrack constructs a dynamicity-aware association with a fine-grained Net, leveraging point-level visual cues. Correspondingly, a fine-grained sampler and matching method have been incorporated. Furthermore, NetTrack learns object-text correspondence for fine-grained localization. To evaluate MOT in extremely dynamic open-world scenarios, a bird flock tracking (BFT) dataset is constructed, which exhibits high dynamicity with diverse species and open-world scenarios. Comprehensive evaluation on BFT validates the effectiveness of fine-grained learning on object dynamicity, and thorough transfer experiments on challenging open-world benchmarks, i.e., TAO, TAO-OW, AnimalTrack, and GMOT-40, validate the strong generalization ability of NetTrack even without finetuning. Project page: https://george-zhuang.github.io/nettrack/.


title: Task-Based Quantizer Design for Sensing With Random Signals

abstract: In integrated sensing and communication (ISAC) systems, random signaling is used to convey useful information as well as sense the environment. Such randomness poses challenges in various components in sensing signal processing. In this paper, we investigate quantizer design for sensing in ISAC systems. Unlike quantizers for channel estimation in massive multiple-input-multiple-out (MIMO) communication systems, sensing in ISAC systems needs to deal with random nonorthogonal transmitted signals rather than a fixed orthogonal pilot. Considering sensing performance and hardware implementation, we focus on task-based hardware-limited quantization with spatial analog combining. We propose two strategies of quantizer optimization, i.e., data-dependent (DD) and data-independent (DI). The former achieves optimized sensing performance with high implementation overhead. To reduce hardware complexity, the latter optimizes the quantizer with respect to the random signal from a stochastic perspective. We derive the optimal quantizers for both strategies and formulate an algorithm based on sample average approximation (SAA) to solve the optimization in the DI strategy. Numerical results show that the optimized quantizers outperform digital-only quantizers in terms of sensing performance. Additionally, the DI strategy, despite its lower computational complexity compared to the DD strategy, achieves near-optimal sensing performance.


title: Designs in finite classical polar spaces

abstract: Combinatorial designs have been studied for nearly 200 years. 50 years ago, Cameron, Delsarte, and Ray-Chaudhury started investigating their $q$-analogs, also known as subspace designs or designs over finite fields. Designs can be defined analogously in finite classical polar spaces, too. The definition includes the $m$-regular systems from projective geometry as the special case where the blocks are generators of the polar space. The first nontrivial such designs for $t > 1$ were found by De Bruyn and Vanhove in 2012, and some more designs appeared recently in the PhD thesis of Lansdown. In this article, we investigate the theory of classical and subspace designs for applicability to designs in polar spaces, explicitly allowing arbitrary block dimensions. In this way, we obtain divisibility conditions on the parameters, derived and residual designs, intersection numbers and an analog of Fisher's inequality. We classify the parameters of symmetric designs. Furthermore, we conduct a computer search to construct designs of strength $t=2$, resulting in designs for more than 140 previously unknown parameter sets in various classical polar spaces over $\mathbb{F}_2$ and $\mathbb{F}_3$.


title: Boosting Semi-Supervised Temporal Action Localization by Learning from Non-Target Classes

abstract: The crux of semi-supervised temporal action localization (SS-TAL) lies in excavating valuable information from abundant unlabeled videos. However, current approaches predominantly focus on building models that are robust to the error-prone target class (i.e, the predicted class with the highest confidence) while ignoring informative semantics within non-target classes. This paper approaches SS-TAL from a novel perspective by advocating for learning from non-target classes, transcending the conventional focus solely on the target class. The proposed approach involves partitioning the label space of the predicted class distribution into distinct subspaces: target class, positive classes, negative classes, and ambiguous classes, aiming to mine both positive and negative semantics that are absent in the target class, while excluding ambiguous classes. To this end, we first devise innovative strategies to adaptively select high-quality positive and negative classes from the label space, by modeling both the confidence and rank of a class in relation to those of the target class. Then, we introduce novel positive and negative losses designed to guide the learning process, pushing predictions closer to positive classes and away from negative classes. Finally, the positive and negative processes are integrated into a hybrid positive-negative learning framework, facilitating the utilization of non-target classes in both labeled and unlabeled videos. Experimental results on THUMOS14 and ActivityNet v1.3 demonstrate the superiority of the proposed method over prior state-of-the-art approaches.


title: Numerical Realization of Dynamical Fermionization and Bethe Rapidities in a cold quenched Bose gas

abstract: In this numerical investigation, we explore the non-equilibrium dynamics of a cold Lieb-Liniger (LL) Bose gas -- a well established integrable quantum system in one dimension exhibiting repulsive interactions. Our study involves the presence of a hard wall potential during the ballistic expansion of the Bose gas from its ground state within an infinite deep box of length L0 to a final length L. The Quantum Monte Carlo method, based on the Generalized Feynman-Kac approach, serves as our computational tool. Given the integrability of the Lieb-Liniger model, strongly correlated systems resist thermalization. To capture the intricate dynamics we employ the concept of Bethe Rapidities(BRs), a holistic function that extends beyond atomic or energy density considerations. Our thought experiment involves a box-to-box expansion, providing a unique opportunity for direct numerical observation of Bethe Rapidities and the phenomenon of Dynamical Fermionization(DF). This investigation aims to contribute insights into the behavior of strongly correlated quantum systems during non-equilibrium processes, offering a detailed examination of Bethe Rapidities and the dynamic evolution of Fermionization throughout the expansion.


title: Generalised core partitions and Diophantine equations

abstract: We study generalised core partitions arising from affine Grassmannian elements in arbitrary Dynkin type. The corresponding notion of size is given by the atomic length in the sense of [CLG22]. In this paper, we first develop the theory for extended affine Weyl groups. In a series of applications, we give some remarkable parametrisations of the solutions of certain Diophantine equations resembling Pell's equation, by refining the results of [BN22] and [Alp14], and generalising them to further types.


title: Self-Supervised Video Desmoking for Laparoscopic Surgery

abstract: Due to the difficulty of collecting real paired data, most existing desmoking methods train the models by synthesizing smoke, generalizing poorly to real surgical scenarios. Although a few works have explored single-image real-world desmoking in unpaired learning manners, they still encounter challenges in handling dense smoke. In this work, we address these issues together by introducing the self-supervised surgery video desmoking (SelfSVD). On the one hand, we observe that the frame captured before the activation of high-energy devices is generally clear (named pre-smoke frame, PS frame), thus it can serve as supervision for other smoky frames, making real-world self-supervised video desmoking practically feasible. On the other hand, in order to enhance the desmoking performance, we further feed the valuable information from PS frame into models, where a masking strategy and a regularization term are presented to avoid trivial solutions. In addition, we construct a real surgery video dataset for desmoking, which covers a variety of smoky scenes. Extensive experiments on the dataset show that our SelfSVD can remove smoke more effectively and efficiently while recovering more photo-realistic details than the state-of-the-art methods. The dataset, codes, and pre-trained models are available at \url{https://github.com/ZcsrenlongZ/SelfSVD}.


title: Neural Markov Random Field for Stereo Matching

abstract: Stereo matching is a core task for many computer vision and robotics applications. Despite their dominance in traditional stereo methods, the hand-crafted Markov Random Field (MRF) models lack sufficient modeling accuracy compared to end-to-end deep models. While deep learning representations have greatly improved the unary terms of the MRF models, the overall accuracy is still severely limited by the hand-crafted pairwise terms and message passing. To address these issues, we propose a neural MRF model, where both potential functions and message passing are designed using data-driven neural networks. Our fully data-driven model is built on the foundation of variational inference theory, to prevent convergence issues and retain stereo MRF's graph inductive bias. To make the inference tractable and scale well to high-resolution images, we also propose a Disparity Proposal Network (DPN) to adaptively prune the search space of disparity. The proposed approach ranks $1^{st}$ on both KITTI 2012 and 2015 leaderboards among all published methods while running faster than 100 ms. This approach significantly outperforms prior global methods, e.g., lowering D1 metric by more than 50% on KITTI 2015. In addition, our method exhibits strong cross-domain generalization and can recover sharp edges. The codes at https://github.com/aeolusguan/NMRF


title: MaskDiffusion: Exploiting Pre-trained Diffusion Models for Semantic Segmentation

abstract: Semantic segmentation is essential in computer vision for various applications, yet traditional approaches face significant challenges, including the high cost of annotation and extensive training for supervised learning. Additionally, due to the limited predefined categories in supervised learning, models typically struggle with infrequent classes and are unable to predict novel classes. To address these limitations, we propose MaskDiffusion, an innovative approach that leverages pretrained frozen Stable Diffusion to achieve open-vocabulary semantic segmentation without the need for additional training or annotation, leading to improved performance compared to similar methods. We also demonstrate the superior performance of MaskDiffusion in handling open vocabularies, including fine-grained and proper noun-based categories, thus expanding the scope of segmentation applications. Overall, our MaskDiffusion shows significant qualitative and quantitative improvements in contrast to other comparable unsupervised segmentation methods, i.e. on the Potsdam dataset (+10.5 mIoU compared to GEM) and COCO-Stuff (+14.8 mIoU compared to DiffSeg). All code and data will be released at https://github.com/Valkyrja3607/MaskDiffusion.


title: Merons and magnetoelectric switching in centrosymmetric spiral magnets

abstract: Spiral multiferroics exhibit a strong coupling between magnetic and ferroelectric orders, allowing cross-control. Since the seminal work of Kimura et al. in 2003, these materials have attracted great interest galvanized by the prospect of new high-efficiency memory devices, where magnetic (electric) bits are switched via an external electric (magnetic) field. Nevertheless, the mechanism underlying such a switching process - the electric field-driven dynamics of domain walls (DWs) - is still poorly understood. We address this problem for meron DWs, which represent one of the main DW types in spiral multiferroics and consist of an array of meron (half-skyrmion) strings. Minimum energy walls feature merons with alternating topological charges and move as relativistic massive particles, with the limiting velocity set by magnon speed. Low-energy defects in this alternating charge sequence, which appear during domain nucleation, can lead to DWs with net topological charge. This induces a peculiar non-local dynamics where all the spins in the system rotate, merons translate within the wall, and the DW mobility is suppressed. The topological charge of the wall and the meron helicity can be easily modified via an external magnetic and electric field, respectively, offering fine control over DW dynamics. Defects within the meron strings, analogous to Bloch points, have hedgehog-like spin texture and are strongly pinned to the lattice. The fascinating interplay between domain wall motion, translation of merons within the wall, and precession of spins in the entire domains opens a new playground for the electric manipulation of topological spin textures.


title: Mesh-free mixed finite element approximation for nonlinear time-fractional biharmonic problem using weighted b-splines

abstract: In this article, we propose a fully-discrete scheme for the numerical solution of a nonlinear time-fractional biharmonic problem. This problem is first converted into an equivalent system by introducing a new variable. Then spatial and temporal discretizations are done by the weighted $b$-spline method and $L2$-$1_\sigma$ approximation, respectively. The weighted $b$-spline method uses weighted $b$-splines on a tensor product grid as basis functions for the finite element space and by construction, it is a mesh-free method. This method combines the computational benefits of $b$-splines and standard mesh-based elements. We derive $\alpha$-robust \emph{a priori} bound and convergence estimate in the $L^2(\Omega)$ norm for the proposed scheme. Finally, we carry out few numerical experiments to support our theoretical findings.


title: TAG: Guidance-free Open-Vocabulary Semantic Segmentation

abstract: Semantic segmentation is a crucial task in computer vision, where each pixel in an image is classified into a category. However, traditional methods face significant challenges, including the need for pixel-level annotations and extensive training. Furthermore, because supervised learning uses a limited set of predefined categories, models typically struggle with rare classes and cannot recognize new ones. Unsupervised and open-vocabulary segmentation, proposed to tackle these issues, faces challenges, including the inability to assign specific class labels to clusters and the necessity of user-provided text queries for guidance. In this context, we propose a novel approach, TAG which achieves Training, Annotation, and Guidance-free open-vocabulary semantic segmentation. TAG utilizes pre-trained models such as CLIP and DINO to segment images into meaningful categories without additional training or dense annotations. It retrieves class labels from an external database, providing flexibility to adapt to new scenarios. Our TAG achieves state-of-the-art results on PascalVOC, PascalContext and ADE20K for open-vocabulary segmentation without given class names, i.e. improvement of +15.3 mIoU on PascalVOC. All code and data will be released at https://github.com/Valkyrja3607/TAG.


title: Learning-Based Wiping Behavior of Low-Rigidity Robots Considering Various Surface Materials and Task Definitions

abstract: Wiping behavior is a task of tracing the surface of an object while feeling the force with the palm of the hand. It is necessary to adjust the force and posture appropriately considering the various contact conditions felt by the hand. Several studies have been conducted on the wiping motion, however, these studies have only dealt with a single surface material, and have only considered the application of the amount of appropriate force, lacking intelligent movements to ensure that the force is applied either evenly to the entire surface or to a certain area. Depending on the surface material, the hand posture and pressing force should be varied appropriately, and this is highly dependent on the definition of the task. Also, most of the movements are executed by high-rigidity robots that are easy to model, and few movements are executed by robots that are low-rigidity but therefore have a small risk of damage due to excessive contact. So, in this study, we develop a method of motion generation based on the learned prediction of contact force during the wiping motion of a low-rigidity robot. We show that MyCobot, which is made of low-rigidity resin, can appropriately perform wiping behaviors on a plane with multiple surface materials based on various task definitions.


title: Graph Unitary Message Passing

abstract: Message passing mechanism contributes to the success of GNNs in various applications, but also brings the oversquashing problem. Recent works combat oversquashing by improving the graph spectrums with rewiring techniques, disrupting the structural bias in graphs, and having limited improvement on oversquashing in terms of oversquashing measure. Motivated by unitary RNN, we propose Graph Unitary Message Passing (GUMP) to alleviate oversquashing in GNNs by applying unitary adjacency matrix for message passing. To design GUMP, a transformation is first proposed to make general graphs have unitary adjacency matrix and keep its structural bias. Then, unitary adjacency matrix is obtained with a unitary projection algorithm, which is implemented by utilizing the intrinsic structure of unitary adjacency matrix and allows GUMP to be permutation-equivariant. Experimental results show the effectiveness of GUMP in improving the performance on various graph learning tasks.


title: From habitat decline to collapse: a spatially explicit approach connecting habitat degradation to destruction

abstract: Habitat loss, through degradation and destruction of viable habitat, has a well-documented and undeniable impact on the sustainability of ecosystems [Diaz et al. (2019), Pimm et al. (2014), Pimm et al. (2000)]. Moreover, most habitat loss is anthropogenic [Jacobson et al. (2019)]. Understanding the relationships between varying degrees of habitat degradation, movement strategies, and population dynamics on species persistence is crucial. We establish a robust connection between habitat degradation and destruction using a reaction-diffusion equation framework. Motivated by the recent work [Salmaniw et al. (2022)], we consider an intrinsic growth rate function that features a logistic-type growth in the viable habitat but decays at rate $c\geq0$ in the degraded region(s). In the limit as $c \to \infty$, the solution to the habitat degradation problem converges uniformly to the solution of a related habitat destruction problem. When the habitat destruction problem predicts deterministic extinction, a unique value $c_0$ exists, the extinction threshold, from which any further habitat degradation leads to deterministic extinction. This extinction threshold can be bounded below by a constant depending on the size of the degraded region and the habitat quality in the undisturbed region. To show these results, we investigate the eigenvalue problems related to each model formulation and establish a convergence result between the principal eigenvalues and their associated eigenfunctions, providing a precise analytical connection between habitat degradation and destruction in a general setting applicable to any species adopting diffusive movement strategies.


title: Dynamics of two by two symmetric matrices of trace zero

abstract: In this paper, we describe the entire structure of the vector space $Sym_2^0$ of all symmetric matrices of size $2$ having trace zero. This is motivated by the geometrical interpretation of any arbitrary element of $Sym_2^0$. We further study the orbits and stable sets of these elements. As an application of the obtained structure of $Sym_2^0$, we obtain the symmetric matrices of size $2$, trace of whose product with any trace zero symmetric matrix is zero. Finally some well known trigonometric formulas are interpreted geometrically incorporating the anatomy of $Sym_2^0$.


title: Data is all you need: Finetuning LLMs for Chip Design via an Automated design-data augmentation framework

abstract: Recent advances in large language models have demonstrated their potential for automated generation of hardware description language (HDL) code from high-level prompts. Researchers have utilized fine-tuning to enhance the ability of these large language models (LLMs) in the field of Chip Design. However, the lack of Verilog data hinders further improvement in the quality of Verilog generation by LLMs. Additionally, the absence of a Verilog and Electronic Design Automation (EDA) script data augmentation framework significantly increases the time required to prepare the training dataset for LLM trainers. This paper proposes an automated design-data augmentation framework, which generates high-volume and high-quality natural language aligned with Verilog and EDA scripts. For Verilog generation, it translates Verilog files to an abstract syntax tree and then maps nodes to natural language with a predefined template. For Verilog repair, it uses predefined rules to generate the wrong verilog file and then pairs EDA Tool feedback with the right and wrong verilog file. For EDA Script generation, it uses existing LLM(GPT-3.5) to obtain the description of the Script. To evaluate the effectiveness of our data augmentation method, we finetune Llama2-13B and Llama2-7B models using the dataset generated by our augmentation framework. The results demonstrate a significant improvement in the Verilog generation tasks with LLMs. Moreover, the accuracy of Verilog generation surpasses that of the current state-of-the-art open-source Verilog generation model, increasing from 58.8% to 70.6% with the same benchmark. Our 13B model (ChipGPT-FT) has a pass rate improvement compared with GPT-3.5 in Verilog generation and outperforms in EDA script (i.e., SiliconCompiler) generation with only 200 EDA script data.


title: TRELM: Towards Robust and Efficient Pre-training for Knowledge-Enhanced Language Models

abstract: KEPLMs are pre-trained models that utilize external knowledge to enhance language understanding. Previous language models facilitated knowledge acquisition by incorporating knowledge-related pre-training tasks learned from relation triples in knowledge graphs. However, these models do not prioritize learning embeddings for entity-related tokens. Moreover, updating the entire set of parameters in KEPLMs is computationally demanding. This paper introduces TRELM, a Robust and Efficient Pre-training framework for Knowledge-Enhanced Language Models. We observe that entities in text corpora usually follow the long-tail distribution, where the representations of some entities are suboptimally optimized and hinder the pre-training process for KEPLMs. To tackle this, we employ a robust approach to inject knowledge triples and employ a knowledge-augmented memory bank to capture valuable information. Furthermore, updating a small subset of neurons in the feed-forward networks (FFNs) that store factual knowledge is both sufficient and efficient. Specifically, we utilize dynamic knowledge routing to identify knowledge paths in FFNs and selectively update parameters during pre-training. Experimental results show that TRELM reduces pre-training time by at least 50% and outperforms other KEPLMs in knowledge probing tasks and multiple knowledge-aware language understanding tasks.


title: Partitioned Neural Network Training via Synthetic Intermediate Labels

abstract: The proliferation of extensive neural network architectures, particularly deep learning models, presents a challenge in terms of resource-intensive training. GPU memory constraints have become a notable bottleneck in training such sizable models. Existing strategies, including data parallelism, model parallelism, pipeline parallelism, and fully sharded data parallelism, offer partial solutions. Model parallelism, in particular, enables the distribution of the entire model across multiple GPUs, yet the ensuing data communication between these partitions slows down training. Additionally, the substantial memory overhead required to store auxiliary parameters on each GPU compounds computational demands. Instead of using the entire model for training, this study advocates partitioning the model across GPUs and generating synthetic intermediate labels to train individual segments. These labels, produced through a random process, mitigate memory overhead and computational load. This approach results in a more efficient training process that minimizes data communication while maintaining model accuracy. To validate this method, a 6-layer fully connected neural network is partitioned into two parts and its performance is assessed on the extended MNIST dataset. Experimental results indicate that the proposed approach achieves similar testing accuracies to conventional training methods, while significantly reducing memory and computational requirements. This work contributes to mitigating the resource-intensive nature of training large neural networks, paving the way for more efficient deep learning model development.


title: Continuous Jumping of a Parallel Wire-Driven Monopedal Robot RAMIEL Using Reinforcement Learning

abstract: We have developed a parallel wire-driven monopedal robot, RAMIEL, which has both speed and power due to the parallel wire mechanism and a long acceleration distance. RAMIEL is capable of jumping high and continuously, and so has high performance in traveling. On the other hand, one of the drawbacks of a minimal parallel wire-driven robot without joint encoders is that the current joint velocities estimated from the wire lengths oscillate due to the elongation of the wires, making the values unreliable. Therefore, despite its high performance, the control of the robot is unstable, and in 10 out of 16 jumps, the robot could only jump up to two times continuously. In this study, we propose a method to realize a continuous jumping motion by reinforcement learning in simulation, and its application to the actual robot. Because the joint velocities oscillate with the elongation of the wires, they are not used directly, but instead are inferred from the time series of joint angles. At the same time, noise that imitates the vibration caused by the elongation of the wires is added for transfer to the actual robot. The results show that the system can be applied to the actual robot RAMIEL as well as to the stable continuous jumping motion in simulation.


title: CBR -- Boosting Adaptive Classification By Retrieval of Encrypted Network Traffic with Out-of-distribution

abstract: Encrypted network traffic Classification tackles the problem from different approaches and with different goals. One of the common approaches is using Machine learning or Deep Learning-based solutions on a fixed number of classes, leading to misclassification when an unknown class is given as input. One of the solutions for handling unknown classes is to retrain the model, however, retraining models every time they become obsolete is both resource and time-consuming. Therefore, there is a growing need to allow classification models to detect and adapt to new classes dynamically, without retraining, but instead able to detect new classes using few shots learning [1]. In this paper, we introduce Adaptive Classification By Retrieval CBR, a novel approach for encrypted network traffic classification. Our new approach is based on an ANN-based method, which allows us to effectively identify new and existing classes without retraining the model. The novel approach is simple, yet effective and achieved similar results to RF with up to 5% difference (usually less than that) in the classification tasks while having a slight decrease in the case of new samples (from new classes) without retraining. To summarize, the new method is a real-time classification, which can classify new classes without retraining. Furthermore, our solution can be used as a complementary solution alongside RF or any other machine/deep learning classification method, as an aggregated solution.


title: MindEye2: Shared-Subject Models Enable fMRI-To-Image With 1 Hour of Data

abstract: Reconstructions of visual perception from brain activity have improved tremendously, but the practical utility of such methods has been limited. This is because such models are trained independently per subject where each subject requires dozens of hours of expensive fMRI training data to attain high-quality results. The present work showcases high-quality reconstructions using only 1 hour of fMRI training data. We pretrain our model across 7 subjects and then fine-tune on minimal data from a new subject. Our novel functional alignment procedure linearly maps all brain data to a shared-subject latent space, followed by a shared non-linear mapping to CLIP image space. We then map from CLIP space to pixel space by fine-tuning Stable Diffusion XL to accept CLIP latents as inputs instead of text. This approach improves out-of-subject generalization with limited training data and also attains state-of-the-art image retrieval and reconstruction metrics compared to single-subject approaches. MindEye2 demonstrates how accurate reconstructions of perception are possible from a single visit to the MRI facility. All code is available on GitHub.


title: THOR: Text to Human-Object Interaction Diffusion via Relation Intervention

abstract: This paper addresses new methodologies to deal with the challenging task of generating dynamic Human-Object Interactions from textual descriptions (Text2HOI). While most existing works assume interactions with limited body parts or static objects, our task involves addressing the variation in human motion, the diversity of object shapes, and the semantic vagueness of object motion simultaneously. To tackle this, we propose a novel Text-guided Human-Object Interaction diffusion model with Relation Intervention (THOR). THOR is a cohesive diffusion model equipped with a relation intervention mechanism. In each diffusion step, we initiate text-guided human and object motion and then leverage human-object relations to intervene in object motion. This intervention enhances the spatial-temporal relations between humans and objects, with human-centric interaction representation providing additional guidance for synthesizing consistent motion from text. To achieve more reasonable and realistic results, interaction losses is introduced at different levels of motion granularity. Moreover, we construct Text-BEHAVE, a Text2HOI dataset that seamlessly integrates textual descriptions with the currently largest publicly available 3D HOI dataset. Both quantitative and qualitative experiments demonstrate the effectiveness of our proposed model.


title: Creating an African American-Sounding TTS: Guidelines, Technical Challenges,and Surprising Evaluations

abstract: Representations of AI agents in user interfaces and robotics are predominantly White, not only in terms of facial and skin features, but also in the synthetic voices they use. In this paper we explore some unexpected challenges in the representation of race we found in the process of developing an U.S. English Text-to-Speech (TTS) system aimed to sound like an educated, professional, regional accent-free African American woman. The paper starts by presenting the results of focus groups with African American IT professionals where guidelines and challenges for the creation of a representative and appropriate TTS system were discussed and gathered, followed by a discussion about some of the technical difficulties faced by the TTS system developers. We then describe two studies with U.S. English speakers where the participants were not able to attribute the correct race to the African American TTS voice while overwhelmingly correctly recognizing the race of a White TTS system of similar quality. A focus group with African American IT workers not only confirmed the representativeness of the African American voice we built, but also suggested that the surprising recognition results may have been caused by the inability or the latent prejudice from non-African Americans to associate educated, non-vernacular, professionally-sounding voices to African American people.


title: Error bounds for rank-one DNN reformulation of QAP and DC exact penalty approach

abstract: This paper concerns the quadratic assignment problem (QAP), a class of challenging combinatorial optimization problems. We provide an equivalent rank-one doubly nonnegative (DNN) reformulation with fewer equality constraints, and derive the local error bounds for its feasible set. By leveraging these error bounds, we prove that the penalty problem induced by the difference of convexity (DC) reformulation of the rank-one constraint is a global exact penalty, and so is the penalty problem for its Burer-Monteiro (BM) factorization. As a byproduct, we verify that the penalty problem for the rank-one DNN reformulation proposed in \cite{Jiang21} is a global exact penalty without the calmness assumption. Then, we develop a continuous relaxation approach by seeking approximate stationary points of a finite number of penalty problems for the BM factorization with an augmented Lagrangian method, whose asymptotic convergence certificate is also provided under a mild condition. Numerical comparison with Gurobi for \textbf{131} benchmark instances validates the efficiency of the proposed DC exact penalty approach.


title: RCdpia: A Renal Carcinoma Digital Pathology Image Annotation dataset based on pathologists

abstract: The annotation of digital pathological slide data for renal cell carcinoma is of paramount importance for correct diagnosis of artificial intelligence models due to the heterogeneous nature of the tumor. This process not only facilitates a deeper understanding of renal cell cancer heterogeneity but also aims to minimize noise in the data for more accurate studies. To enhance the applicability of the data, two pathologists were enlisted to meticulously curate, screen, and label a kidney cancer pathology image dataset from The Cancer Genome Atlas Program (TCGA) database. Subsequently, a Resnet model was developed to validate the annotated dataset against an additional dataset from the First Affiliated Hospital of Zhejiang University. Based on these results, we have meticulously compiled the TCGA digital pathological dataset with independent labeling of tumor regions and adjacent areas (RCdpia), which includes 109 cases of kidney chromophobe cell carcinoma, 486 cases of kidney clear cell carcinoma, and 292 cases of kidney papillary cell carcinoma. This dataset is now publicly accessible at http://39.171.241.18:8888/RCdpia/. Furthermore, model analysis has revealed significant discrepancies in predictive outcomes when applying the same model to datasets from different centers. Leveraging the RCdpia, we can now develop more precise digital pathology artificial intelligence models for tasks such as normalization, classification, and segmentation. These advancements underscore the potential for more nuanced and accurate AI applications in the field of digital pathology.


title: Carroll-Schr\"odinger Equation

abstract: The Poincar\'e symmetry can be contracted in two ways to yield the Galilei symmetry and the Carroll symmetry. The Schr\"odinger equation exhibits the Galilei symmetry and is a fundamental equation in Galilean quantum mechanics. However, the question remains: what is the quantum equation that corresponds to the Carroll symmetry? In this paper, we derive a novel equation, called the Carroll-Schr\"odinger equation, which describes the quantum dynamics in the Carrollian framework. We also introduce the Carroll-Schr\"odinger algebra, which is a conformal extension of the centrally extended Carroll algebra, and show that it is the symmetry algebra of the Carroll-Schr\"odinger equation in two dimensions. We generalize our results to arbitrary dimensions and discuss some possible applications and extensions of our work.


title: Simultaneous Cutoff on the Multitype Configuration Model

abstract: We find Gaussian cutoff profiles for the total variation distance to stationarity of a random walk on a multiplex network: a finite number of directed configuration models sharing a vertex set, each with its own bounded degree distribution and edge probability. Further we consider the minimal total variation distance over this space of possible doubly stochastic edge probabilities at each point in time. Looking at all possible dynamics simultaneously on one realisation of the random graph, we find that this sequence of minimal distances converges in probability to the same cutoff profile as the chain with entropy maximising transition probabilities.


title: Observation of spin-electric transitions in a molecular exchange qubit

abstract: Electric fields represent an ideal means for controlling spins at the nanoscale and, more specifically, for manipulating protected degrees of freedom in multispin systems. Here we perform low-temperature magnetic far-IR spectroscopy on a molecular spin triangle (Fe3) and provide the first experimental evidence of spin-electric transitions in polynuclear complexes. The co-presence of electric- and magnetic-dipole transitions, allows us to estimate the spin-electric coupling. Based on spin Hamiltonian simulations of the spectra, we identify the observed transitions and introduce the concept of a generalized exchange qubit. This applies to a wide class of molecular spin triangles, and includes the scalar chirality and the partial spin sum qubits as special cases.


title: Reduced model and nonlinear analysis of localized instabilities of residually stressed cylinders under axial stretch

abstract: In this paper we present a dimensional reduction to obtain a one-dimensional model to analyze localized necking or bulging in a residually stressed circular cylindrical solid. The nonlinear theory of elasticity is first specialized to obtain the equations governing the homogeneous deformation. Then, to analyze the non-homogeneous part, we include higher order correction terms of the axisymmetric displacement components leading to a three-dimensional form of the total potential energy functional. Details of the reduction to the one-dimensional form are given. We focus on a residually stressed Gent material and use numerical methods to solve the governing equations. Two loading conditions are considered. In the first, the residual stress is maintained constant, while the axial stretch is used as the loading parameter. In the second, we keep the pre-stretch constant and monotonically increase the residual stress until bifurcation occurs. We specify initial conditions, find the critical values for localized bifurcation and compute the change in radius during localized necking or bulging growth. Finally, we optimize material properties and use the one-dimensional model to simulate necking or bulging until the Maxwell values of stretch are reached.


title: Tell machine learning potentials what they are needed for: Simulation-oriented training exemplified for glycine

abstract: Machine learning potentials (MLPs) are widely applied as an efficient alternative way to represent potential energy surfaces (PES) in many chemical simulations. The MLPs are often evaluated with the root-mean-square errors on the test set drawn from the same distribution as the training data. Here, we systematically investigate the relationship between such test errors and the simulation accuracy with MLPs on an example of a full-dimensional, global PES for the glycine amino acid. Our results show that the errors in the test set do not unambiguously reflect the MLP performance in different simulation tasks such as relative conformer energies, barriers, vibrational levels, and zero-point vibrational energies. We also offer an easily accessible solution for improving the MLP quality in a simulation-oriented manner, yielding the most precise relative conformer energies and barriers. This solution also passed the stringent test by the diffusion Monte Carlo simulations.


title: Research on Personal Credit Risk Assessment Methods Based on Causal Inference

abstract: The discussion on causality in human history dates back to ancient Greece, yet to this day, there is still no consensus. Fundamentally, this stems from the nature of human cognition, as understanding causality requires abstract tools to transcend the limitations of human cognition. In recent decades, the rapid development of mathematical and computational tools has provided new theoretical and technical means for exploring causality, creating more avenues for investigation. Based on this, this paper introduces a new definition of causality using category theory, proposed by Samuel Eilenberg and Saunders Mac Lane in 1945 to avoid the self-referential contradictions in set theory, notably the Russell paradox. Within this framework, the feasibility of indicator synthesis in causal inference is demonstrated. Due to the limitations in the development of category theory-related technical tools, this paper adopts the widely-used probabilistic causal graph tool proposed by Judea Pearl in 1995 to study the application of causal inference in personal credit risk management. The specific work includes: research on the construction method of causal inference index system, definition of causality and feasibility proof of indicator synthesis causal inference within this framework, application methods of causal graph model and intervention alternative criteria in personal credit risk management, and so on.


title: Non-Fermi liquid behavior of scattering rate in three-orbital Emery model

abstract: Motivated by the recent findings on the $T$-linear electronic scattering rate in the two-dimensional Hubbard model, we have investigated the three-orbital Emery model and its temperature-dependent electronic and quasiparticle scattering rates by adopting dynamical cluster quantum Monte Carlo simulations. By focusing on two characteristic site energies $\epsilon_p$ of O-2$p$ orbital relevant to cuprates and nickelates separately, our exploration discovered that, for $\epsilon_p=3.24$ relevant to cuprates, the scattering rate can exhibit a linear-$T$ dependence at low temperature for a range of intermediate densities. In contrast, for larger $\epsilon_p=6.0$ presumably relevant to nickelates, a wide range of densities support a downturn of the scattering rate below the temperature scale $T\sim0.1$ with possibly two consecutive nearly linear-$T$ regimes connected via a smooth crossover around $T\sim0.1$. Furthermore, the temperature dependent quasiparticle scattering rate generically departs from the unity slope as predicted by the Planckian dissipation theory. Our presented work provides valuable insights on the extensively studied three-orbital Emery model, particularly on the quantitative examination of non-Fermi liquid features of scattering rates.


title: Causality from Bottom to Top: A Survey

abstract: Causality has become a fundamental approach for explaining the relationships between events, phenomena, and outcomes in various fields of study. It has invaded various fields and applications, such as medicine, healthcare, economics, finance, fraud detection, cybersecurity, education, public policy, recommender systems, anomaly detection, robotics, control, sociology, marketing, and advertising. In this paper, we survey its development over the past five decades, shedding light on the differences between causality and other approaches, as well as the preconditions for using it. Furthermore, the paper illustrates how causality interacts with new approaches such as Artificial Intelligence (AI), Generative AI (GAI), Machine and Deep Learning, Reinforcement Learning (RL), and Fuzzy Logic. We study the impact of causality on various fields, its contribution, and its interaction with state-of-the-art approaches. Additionally, the paper exemplifies the trustworthiness and explainability of causality models. We offer several ways to evaluate causality models and discuss future directions.


title: CPA-Enhancer: Chain-of-Thought Prompted Adaptive Enhancer for Object Detection under Unknown Degradations

abstract: Object detection methods under known single degradations have been extensively investigated. However, existing approaches require prior knowledge of the degradation type and train a separate model for each, limiting their practical applications in unpredictable environments. To address this challenge, we propose a chain-of-thought (CoT) prompted adaptive enhancer, CPA-Enhancer, for object detection under unknown degradations. Specifically, CPA-Enhancer progressively adapts its enhancement strategy under the step-by-step guidance of CoT prompts, that encode degradation-related information. To the best of our knowledge, it's the first work that exploits CoT prompting for object detection tasks. Overall, CPA-Enhancer is a plug-and-play enhancement model that can be integrated into any generic detectors to achieve substantial gains on degraded images, without knowing the degradation type priorly. Experimental results demonstrate that CPA-Enhancer not only sets the new state of the art for object detection but also boosts the performance of other downstream vision tasks under unknown degradations.


title: Lion: Minimizing Distributed Transactions through Adaptive Replica Provision (Extended Version)

abstract: Distributed transaction processing often involves multiple rounds of cross-node communications, and therefore tends to be slow. To improve performance, existing approaches convert distributed transactions into single-node transactions by either migrating co-accessed partitions onto the same nodes or establishing a super node housing replicas of the entire database. However, migration-based methods might cause transactions to be blocked due to waiting for data migration, while the super node can become a bottleneck. In this paper, we present Lion, a novel transaction processing protocol that utilizes partition-based replication to reduce the occurrence of distributed transactions. Lion aims to assign a node with one replica from each partition involved in a given transaction's read or write operations. To ensure such a node is available, we propose an adaptive replica provision mechanism, enhanced with an LSTM-based workload prediction algorithm, to determine the appropriate node for locating replicas of co-accessed partitions. The adaptation of replica placement is conducted preemptively and asynchronously, thereby minimizing its impact on performance. By employing this adaptive replica placement strategy, we ensure that the majority of transactions can be efficiently processed on a single node without additional overhead. Only a small fraction of transactions will need to be treated as regular distributed transactions when such a node is unavailable. Consequently, Lion effectively minimizes distributed transactions while avoiding any disruption caused by data migration or the creation of a super node. We conduct extensive experiments to compare Lion against various transaction processing protocols. The results show that Lion achieves up to 2.7x higher throughput and 76.4% better scalability against these state-of-the-art approaches.


title: SpikeNeRF: Learning Neural Radiance Fields from Continuous Spike Stream

abstract: Spike cameras, leveraging spike-based integration sampling and high temporal resolution, offer distinct advantages over standard cameras. However, existing approaches reliant on spike cameras often assume optimal illumination, a condition frequently unmet in real-world scenarios. To address this, we introduce SpikeNeRF, the first work that derives a NeRF-based volumetric scene representation from spike camera data. Our approach leverages NeRF's multi-view consistency to establish robust self-supervision, effectively eliminating erroneous measurements and uncovering coherent structures within exceedingly noisy input amidst diverse real-world illumination scenarios. The framework comprises two core elements: a spike generation model incorporating an integrate-and-fire neuron layer and parameters accounting for non-idealities, such as threshold variation, and a spike rendering loss capable of generalizing across varying illumination conditions. We describe how to effectively optimize neural radiance fields to render photorealistic novel views from the novel continuous spike stream, demonstrating advantages over other vision sensors in certain scenes. Empirical evaluations conducted on both real and novel realistically simulated sequences affirm the efficacy of our methodology. The dataset and source code are released at https://github.com/BIT-Vision/SpikeNeRF.


title: Obligatory hypergraphs

abstract: Erd\H{o}s and Hajnal proved that every graph of uncountable chromatic number contains arbitrarily large finite, complete, bipartite graphs. We extend this result to hypergraphs.


title: An exact formula for the optical conductivity of the two dimensional Hubbard model and its application to the cuprate superconductors

abstract: Understanding the origin of electron incoherence is believed to be the first step toward the resolution of the mysteries of the high-T$_{c}$ cuprate superconductors. Such electron incoherence manifests itself most evidently in the non-Drude form of the optical absorption spectrum of the system. The spectral weight transfer related to such dissipative response, which is absent in conventional Fermi liquid metal, has direct consequence on the dc transport property of the system. However, a theoretical study of the optical conductivity of a strongly correlated model is a formidable task. Here we present an exact formula for the optical conductivity of the 2D Hubbard model from the low energy effective theory perspective. We show that the optical conductivity in Matsubara frequency of the 2D Hubbard model can be represented as the ensemble average of the optical conductivity of non-interacting systems in the background of fluctuating local moment. We find that such an ensemble average can be done exactly with a sign-problem-free Monte Carlo simulation if we assume the widely adopted Millis-Monien-Pines spin susceptibility for the fluctuating local moment. For thermal fluctuation of the local moment, our formula can be used to calculate directly the optical conductivity in real frequency which can be compared with the result of optical measurements in the cuprate superconductors.


title: The Negative Energy Sea

abstract: The Dirac negative energy sea introduced the concept of antimatter, and explained it, not least in its relationship to negative-energy solutions to the wave equation. Post-war, it was largely displaced by what I shall call the 'standard formalism', dependent, among other things, on normal-ordering. A much better explanation is provided by the 'two complex structures' viewpoint, as first introduced by Irving Segal: the one ('natural') kind of complex numbers at the level of covariant, local fields; and the other ('particle') complex numbers at the level of the one-particle Hilbert space and Fock space. The former is local, the latter non-local: therein lies the fundamental difference between relativistic and non-relativistic quantum theory.


title: Multiple Teachers-Meticulous Student: A Domain Adaptive Meta-Knowledge Distillation Model for Medical Image Classification

abstract: Background: Image classification can be considered one of the key pillars of medical image analysis. Deep learning (DL) faces challenges that prevent its practical applications despite the remarkable improvement in medical image classification. The data distribution differences can lead to a drop in the efficiency of DL, known as the domain shift problem. Besides, requiring bulk annotated data for model training, the large size of models, and the privacy-preserving of patients are other challenges of using DL in medical image classification. This study presents a strategy that can address the mentioned issues simultaneously. Method: The proposed domain adaptive model based on knowledge distillation can classify images by receiving limited annotated data of different distributions. The designed multiple teachers-meticulous student model trains a student network that tries to solve the challenges by receiving the parameters of several teacher networks. The proposed model was evaluated using six available datasets of different distributions by defining the respiratory motion artefact detection task. Results: The results of extensive experiments using several datasets show the superiority of the proposed model in addressing the domain shift problem and lack of access to bulk annotated data. Besides, the privacy preservation of patients by receiving only the teacher network parameters instead of the original data and consolidating the knowledge of several DL models into a model with almost similar performance are other advantages of the proposed model. Conclusions: The proposed model can pave the way for practical clinical applications of deep classification methods by achieving the mentioned objectives simultaneously.


title: Cheap Ways of Extracting Clinical Markers from Texts

abstract: This paper describes the work of the UniBuc Archaeology team for CLPsych's 2024 Shared Task, which involved finding evidence within the text supporting the assigned suicide risk level. Two types of evidence were required: highlights (extracting relevant spans within the text) and summaries (aggregating evidence into a synthesis). Our work focuses on evaluating Large Language Models (LLM) as opposed to an alternative method that is much more memory and resource efficient. The first approach employs a good old-fashioned machine learning (GOML) pipeline consisting of a tf-idf vectorizer with a logistic regression classifier, whose representative features are used to extract relevant highlights. The second, more resource intensive, uses an LLM for generating the summaries and is guided by chain-of-thought to provide sequences of text indicating clinical markers.


title: Routing Algorithms

abstract: Routing algorithms play a crucial role in the efficient transmission of data within computer networks by determining the optimal paths for packet forwarding. This paper presents a comprehensive exploration of routing algorithms, focusing on their fundamental principles, classification, challenges, recent advancements, and practical applications. Beginning with an overview of the significance of routing in modern communication networks, the paper delves into the historical evolution of routing algorithms, tracing their development from early approaches to contemporary techniques. Key categories of routing algorithms, including distance vector, link-state, and path vector algorithms, are examined in detail, along with hybrid approaches that integrate multiple routing paradigms. Common challenges faced by routing algorithms, such as routing loops and scalability issues, are identified, and current research efforts aimed at addressing these challenges are discussed.


title: Concatenate, Fine-tuning, Re-training: A SAM-enabled Framework for Semi-supervised 3D Medical Image Segmentation

abstract: Segment Anything Model (SAM) fine-tuning has shown remarkable performance in medical image segmentation in a fully supervised manner, but requires precise annotations. To reduce the annotation cost and maintain satisfactory performance, in this work, we leverage the capabilities of SAM for establishing semi-supervised medical image segmentation models. Rethinking the requirements of effectiveness, efficiency, and compatibility, we propose a three-stage framework, i.e., Concatenate, Fine-tuning, and Re-training (CFR). The current fine-tuning approaches mostly involve 2D slice-wise fine-tuning that disregards the contextual information between adjacent slices. Our concatenation strategy mitigates the mismatch between natural and 3D medical images. The concatenated images are then used for fine-tuning SAM, providing robust initialization pseudo-labels. Afterwards, we train a 3D semi-supervised segmentation model while maintaining the same parameter size as the conventional segmenter such as V-Net. Our CFR framework is plug-and-play, and easily compatible with various popular semi-supervised methods. Extensive experiments validate that our CFR achieves significant improvements in both moderate annotation and scarce annotation across four datasets. In particular, CFR framework improves the Dice score of Mean Teacher from 29.68% to 74.40% with only one labeled data of LA dataset.


title: Simple 2D Convolutional Neural Network-based Approach for COVID-19 Detection

abstract: This study explores the use of deep learning techniques for analyzing lung Computed Tomography (CT) images. Classic deep learning approaches face challenges with varying slice counts and resolutions in CT images, a diversity arising from the utilization of assorted scanning equipment. Typically, predictions are made on single slices which are then combined for a comprehensive outcome. Yet, this method does not incorporate learning features specific to each slice, leading to a compromise in effectiveness. To address these challenges, we propose an advanced Spatial-Slice Feature Learning (SSFL++) framework specifically tailored for CT scans. It aims to filter out out-of-distribution (OOD) data within the entire CT scan, allowing us to select essential spatial-slice features for analysis by reducing data redundancy by 70\%. Additionally, we introduce a Kernel-Density-based slice Sampling (KDS) method to enhance stability during training and inference phases, thereby accelerating convergence and enhancing overall performance. Remarkably, our experiments reveal that our model achieves promising results with a simple EfficientNet-2D (E2D) model. The effectiveness of our approach is confirmed on the COVID-19-CT-DB datasets provided by the DEF-AI-MIA workshop.


title: Uniform (d+1)-bundle over the Grassmannian G(d,n)

abstract: This paper is dedicated to the classification of uniform vector bundles of rank $d+1$ over the Grassmannian $G(d,n)$ ($d\le n-d$) over an algebraically closed field in characteristic $0$. Specifically, we show that all uniform vector bundles with rank $d+1$ over $G(d,n)$ are homogeneous.


title: Observation of unconventional charge order during the transition from Mott-insulator to charge-transfer-insulator in $\alpha$-RuCl$_3$

abstract: The magnetic nature of the Kitaev candidate material $\alpha$-RuCl$_3$ has been widely studied but its charge properties are less known. In the present work, we systematically investigate the scanning tunneling microscopy/spectroscopy (STM/STS) on few-layer $\alpha$-RuCl$_3$ in proximity to graphite. While a single-layer $\alpha$-RuCl$_3$ has a large Mott gap of order 2 eV in spite of charge transferring to the heterointerface from graphite, surface of 2-monolayers (MLs) and 3-MLs samples have a reduced charge gap of order of 200 meV. Furthermore, clear signals of lattice and charge incommensurate super-modulations are observed in 2-MLs $\alpha$-RuCl$_3$ with negative sample biases outside the charge gap. The dI/dV spectra indicates that 2-MLs and 3-MLs $\alpha$-RuCl$_3$ are turned from Mott insulator into charge transfer insulator, while the charge super-modulation suggests the existence of charge density wave induced by incommensurate dipole order.